2022-05-02T09:28:57.282 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-02T09:28:57.283 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446 --verbose --owner scheduled_vshankar@teuthology --name vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446/orig.config.yaml 2022-05-02T09:28:57.380 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-05-02T09:28:57.460 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446 branch: wip-vshankar-testing1-20220428-204527 description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: vshankar@redhat.com first_in_suite: false job_id: '6818446' kernel: flavor: default kdb: true sha1: 5efacacc980658c97571abb0ce2f1ffc0c242411 last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing1-20220428-204527 ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa nuke-on-error: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-20220428-204527 sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa owner: scheduled_vshankar@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing1-20220428-204527 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa targets: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTYIAG/z0aDKFfEorkFkDho5mTe3vPVHkxxdAh0NfNnK4eDwI8HUd54Yqv/6tnThI7Y3bXGUHm6US0Vb2HcWiG71M1wpKgMfJGfgVRWnpZck06TBeMmtzHHeZXdGbg8S8uCRIDTg3agA49yeZ+Ax+8nG3HB/TVILinaLAtdxilfw4AmjmbxhM2dkxNlIkHeLSdi52LwG1drGyJdEwzKFPJcuTxnzeoMbgMoj3moqT7kiSZnTyLq+OC0GTqQsCGxpa5jW2+tWZhixhiAr/FuTSL73godOvo2n1joPwu+x5Av1zkAlpBlnT97fB34ebkb8cOAYvgPIkE9p0tCbx382Jlk6A2yl8SedcA6e4wceOmJatYhSfkpvPXWWXKLnh1dvj9lX4YdIG3BNUCKO9xPdoH/XvxAa4IFqhVAVmEwyGj1fkLHZ0VMB5aBSREvUqq6h7evQEdI6v1EoWBMzlovfihfMWWyU42BdNvawGUTJhXG4Rgun7Xd0ZVwgMpDp2P0= smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMQVn6hj3HbI08xXZl+y52+njGA8SPVtV1MbjIGbJeMnH1/qpcry0zGoz9hXoLYg3TCCWI4sBUnCSpUFiieq1UR+IBuEK2Xy6BfURa1CdFmuviOnca4238sLsdgf2+oIBQxld2PesryjtNN1IWFC7bSjb4VrY4eWnWYPhGtLaLpg3XawSz7Tcx2C5Qakq0mhzRSP7u6T2Hv8XtADsQsukDmZgzZ4qKP8152RoUrZfw9OXplg+w6IXfhfZkXmPLgMFAkEGAIOwbpQhaNzzrB5T3z8o4dUW5Y8JUsPvvFeUtD9k0colBMjANXhGI4xkaD558bNJwyuL/etsGuozIM7pIE+LjjmtAGtDjgRnoUidkkvwtmtuQRDUQqG3qhUFXs5FcDJbQASsLYShCWJuQxmXvzeAcZCO82CRsVtpV+MjNW6BFbejT4fbxiGJ2pBALEG4lO0KnDjBUnru19HpG6WmQxa5i17J4Cq9RgI6GLVO77hgkODDGpFEgGZoWeqy2dIs= smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ84gDDz/yOcq2FtGJv4OPfMFs5v6ke39sTAjQ2Jld7bRLpRZ+jkTDcfyo7pSBjNi6UPkRG1c6PzdIxKYhw7GhAwiPXHjWP5LA/kXLnXHGrvsycFbYFQ6071iEUa/XrDY0UpGkw+0XoISNgQuyDcQrXjqAeeLuHX50FkiBP/2It3KNnpI26p10mRPhP8m1bg+FHNfkBEvyeqQq9zQk1cUJXgUGkV1LYfTVjCuZNgNr1DFgwXDt5m0TVDR8DomqIaN0iCBHAhL9pxFleoA9e6n7k+2jWxd3qtlQLgJxGr3pH1wSpHMkc+i1jQctUMQwoquel9H2JcrJn3d/1wqBJ8EEykvK2aqg0HiJCEvTIeZwDjQgK3WWTUcEqWakgf1d4UtteYj8HMM0pQ25l4MulymgdJFDxbtwOtOs5cId5E0VVZQGZb5aIuc7R1uZ/4zAq7LyF/jQYl+Bfxp2NEN6kuiYy9yJoYfLHkMX+lUMmCTVttqY8h06q2UXjErzrevKkzU= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null mon.b: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology_branch: master teuthology_sha1: fd5c31669e51177d3c57bc0420279c5d1e944497 timestamp: 2022-05-02_09:11:25 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.5191 2022-05-02T09:28:57.461 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa; will attempt to use it 2022-05-02T09:28:57.461 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks 2022-05-02T09:28:57.462 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-05-02T09:28:57.464 INFO:teuthology.task.internal:Checking packages... 2022-05-02T09:28:57.493 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b82312f270e887c49dafe642c4ee39a73bc7d8fa' 2022-05-02T09:28:57.493 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:28:57.494 INFO:teuthology.packaging:ref: None 2022-05-02T09:28:57.494 INFO:teuthology.packaging:tag: None 2022-05-02T09:28:57.494 INFO:teuthology.packaging:branch: wip-vshankar-testing1-20220428-204527 2022-05-02T09:28:57.494 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:28:57.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing1-20220428-204527 2022-05-02T09:28:57.707 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-11888.gb82312f2 2022-05-02T09:28:57.707 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-05-02T09:28:57.720 INFO:teuthology.task.internal:no buildpackages task found 2022-05-02T09:28:57.720 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-05-02T09:28:57.762 INFO:teuthology.task.internal:Saving configuration 2022-05-02T09:28:57.786 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-05-02T09:28:57.852 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-02T09:28:57.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-05-02 09:24:02.950126', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCA+e3JacKoXmPUEIr02pmZ/m3bMrt1W0XK+OiWUCZoazCx5UsHZzn0u1/MX74L+BM3ph40rGA0Q9SK1Pd823o='} 2022-05-02T09:28:57.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-05-02 09:24:02.951232', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFoR8vrvoip4i6779Qn84ho6vQgKVmeFq7GVkAO0ys457JMe4bw1ZyRLIHtfy4p7ZrRTcrHgnsnZ7aQXU2RiPPE='} 2022-05-02T09:28:57.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-05-02 09:24:02.948848', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjN0nUfILbjt8oxxEUfz1PSbyBraN5l1cuPfnycQd9WlNcpq9Fywps2SFcs1xALVfW1saJOO81iy3zAIf5lyYU='} 2022-05-02T09:28:57.922 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-05-02T09:28:57.966 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-05-02T09:28:57.966 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['client.0'] 2022-05-02T09:28:57.966 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['client.1'] 2022-05-02T09:28:57.967 INFO:teuthology.run_tasks:Running task console_log... 2022-05-02T09:28:58.109 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde8b2b0158>, signals=[15]) 2022-05-02T09:28:58.109 INFO:teuthology.run_tasks:Running task internal.connect... 2022-05-02T09:28:58.124 INFO:teuthology.task.internal:Opening connections... 2022-05-02T09:28:58.124 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:28:58.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:28:58.215 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2022-05-02T09:28:58.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:28:58.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2022-05-02T09:28:58.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:28:58.377 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-05-02T09:28:58.388 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2022-05-02T09:28:58.409 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-05-02T09:28:58.410 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2022-05-02T09:28:58.469 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-02T09:28:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2022-05-02T09:28:58.471 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-02T09:28:58.471 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-02T09:28:58.471 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-02T09:28:58.471 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-05-02T09:28:58.491 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2022-05-02T09:28:58.513 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2022-05-02T09:28:58.513 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2022-05-02T09:28:58.573 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2022-05-02T09:28:58.573 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-02T09:28:58.574 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2022-05-02T09:28:58.575 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-02T09:28:58.575 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2022-05-02T09:28:58.575 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-02T09:28:58.575 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-02T09:28:58.575 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-02T09:28:58.575 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-05-02T09:28:58.595 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2022-05-02T09:28:58.615 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2022-05-02T09:28:58.616 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2022-05-02T09:28:58.675 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-02T09:28:58.676 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2022-05-02T09:28:58.676 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-02T09:28:58.676 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-02T09:28:58.676 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-02T09:28:58.676 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2022-05-02T09:28:58.697 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-05-02T09:28:58.712 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-05-02T09:28:58.773 INFO:teuthology.task.internal:Checking for old test directory... 2022-05-02T09:28:58.774 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2022-05-02T09:28:58.776 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2022-05-02T09:28:58.779 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2022-05-02T09:28:58.798 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-05-02T09:28:58.873 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-05-02T09:28:58.873 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2022-05-02T09:28:58.876 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2022-05-02T09:28:58.879 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2022-05-02T09:28:58.912 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-05-02T09:28:59.012 INFO:teuthology.run_tasks:Running task kernel... 2022-05-02T09:28:59.039 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'} 2022-05-02T09:28:59.039 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'}, 'client.0': {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'}, 'client.1': {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'}}, timeout 300 2022-05-02T09:28:59.040 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2022-05-02T09:28:59.040 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2022-05-02T09:28:59.041 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2022-05-02T09:28:59.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:28:59.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2022-05-02T09:28:59.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:28:59.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:28:59.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:28:59.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2022-05-02T09:28:59.156 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2022-05-02T09:28:59.178 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:28:59.178 INFO:teuthology.orchestra.run.smithi086.stdout:CentOSStream 2022-05-02T09:28:59.178 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:28:59.178 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.179 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5efacacc980658c97571abb0ce2f1ffc0c242411"... 2022-05-02T09:28:59.179 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2022-05-02T09:28:59.179 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:28:59.179 DEBUG:teuthology.task.kernel:sha1 for mon.a is 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5efacacc980658c97571abb0ce2f1ffc0c242411"... 2022-05-02T09:28:59.180 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2022-05-02T09:28:59.180 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:28:59.180 DEBUG:teuthology.task.kernel:sha1 for client.1 is 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.180 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5efacacc980658c97571abb0ce2f1ffc0c242411"... 2022-05-02T09:28:59.181 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2022-05-02T09:28:59.200 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-383.el8.x86_64 2022-05-02T09:28:59.200 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-383.el8.x86_64 vs 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.200 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-05-02T09:28:59.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.205 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-383.el8.x86_64 2022-05-02T09:28:59.205 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-383.el8.x86_64 2022-05-02T09:28:59.205 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-383.el8.x86_64 vs 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.205 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-05-02T09:28:59.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.207 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-383.el8.x86_64 vs 5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.207 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-05-02T09:28:59.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:28:59.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum upgrade -y linux-firmware 2022-05-02T09:28:59.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2022-05-02T09:28:59.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum upgrade -y linux-firmware 2022-05-02T09:29:01.875 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - AppStream 33 MB/s | 21 MB 00:00 2022-05-02T09:29:02.178 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - AppStream 26 MB/s | 21 MB 00:00 2022-05-02T09:29:02.328 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 25 MB/s | 21 MB 00:00 2022-05-02T09:29:06.159 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - Base 40 MB/s | 22 MB 00:00 2022-05-02T09:29:06.511 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Base 40 MB/s | 22 MB 00:00 2022-05-02T09:29:06.870 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Base 38 MB/s | 22 MB 00:00 2022-05-02T09:29:09.416 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - Extras 153 kB/s | 18 kB 00:00 2022-05-02T09:29:09.788 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - PowerTools 18 MB/s | 4.5 MB 00:00 2022-05-02T09:29:09.793 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Extras 160 kB/s | 18 kB 00:00 2022-05-02T09:29:10.187 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - PowerTools 17 MB/s | 4.5 MB 00:00 2022-05-02T09:29:10.353 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 141 kB/s | 18 kB 00:00 2022-05-02T09:29:10.747 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - PowerTools 17 MB/s | 4.5 MB 00:00 2022-05-02T09:29:10.793 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2022-05-02T09:29:11.212 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2022-05-02T09:29:11.804 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2022-05-02T09:29:12.122 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 11 MB 00:01 2022-05-02T09:29:12.454 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 11 MB 00:01 2022-05-02T09:29:12.963 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:01 2022-05-02T09:29:14.819 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 404 kB/s | 24 kB 00:00 2022-05-02T09:29:15.088 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 445 kB/s | 24 kB 00:00 2022-05-02T09:29:15.880 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 529 kB/s | 24 kB 00:00 2022-05-02T09:29:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:29:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:29:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:29:17.679 INFO:teuthology.task.kernel:Downloading kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on client.1... 2022-05-02T09:29:17.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2022-05-02T09:29:17.714 INFO:teuthology.orchestra.run.smithi086.stdout:CentOSStream 2022-05-02T09:29:17.715 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:29:17.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:29:17.829 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:29:17.829 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:29:17.829 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:29:17.872 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ 2022-05-02T09:29:17.873 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ --input-file=- 2022-05-02T09:29:17.876 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi086.front.sepia.ceph.com to complete... 2022-05-02T09:29:17.955 INFO:teuthology.task.kernel:Downloading kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on client.0... 2022-05-02T09:29:17.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2022-05-02T09:29:18.031 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2022-05-02T09:29:18.032 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:29:18.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:29:18.186 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ 2022-05-02T09:29:18.186 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ --input-file=- 2022-05-02T09:29:18.188 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2022-05-02T09:29:18.796 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:29:18.797 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:29:18.798 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:29:18.961 INFO:teuthology.task.kernel:Downloading kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on mon.a... 2022-05-02T09:29:18.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:29:18.999 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:29:19.000 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:29:19.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5efacacc980658c97571abb0ce2f1ffc0c242411 2022-05-02T09:29:19.155 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ 2022-05-02T09:29:19.156 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/ --input-file=- 2022-05-02T09:29:19.159 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2022-05-02T09:29:19.744 INFO:teuthology.orchestra.run.smithi086.stderr:2022-05-02 09:29:19 URL:https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm [45221864/45221864] -> "/tmp/kernel.x86_64.rpm" [1] 2022-05-02T09:29:19.745 INFO:teuthology.orchestra.run.smithi086.stderr:FINISHED --2022-05-02 09:29:19-- 2022-05-02T09:29:19.745 INFO:teuthology.orchestra.run.smithi086.stderr:Total wall clock time: 1.8s 2022-05-02T09:29:19.745 INFO:teuthology.orchestra.run.smithi086.stderr:Downloaded: 1 files, 43M in 1.6s (26.6 MB/s) 2022-05-02T09:29:19.746 INFO:teuthology.task.kernel:Installing kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on client.1... 2022-05-02T09:29:19.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-05-02T09:29:20.223 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying... ######################################## 2022-05-02T09:29:20.523 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing... ######################################## 2022-05-02T09:29:20.670 INFO:teuthology.orchestra.run.smithi086.stdout:Updating / installing... 2022-05-02T09:29:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02 09:29:21 URL:https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm [45221864/45221864] -> "/tmp/kernel.x86_64.rpm" [1] 2022-05-02T09:29:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2022-05-02 09:29:21-- 2022-05-02T09:29:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 2.2s 2022-05-02T09:29:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 43M in 1.8s (23.8 MB/s) 2022-05-02T09:29:21.409 INFO:teuthology.task.kernel:Installing kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on mon.a... 2022-05-02T09:29:21.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-05-02T09:29:21.924 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2022-05-02T09:29:22.259 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2022-05-02T09:29:22.378 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2022-05-02T09:29:23.755 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.18.0_rc4_ceph_g5efacacc9806-1######################################## 2022-05-02T09:29:24.829 INFO:teuthology.orchestra.run.smithi073.stderr:2022-05-02 09:29:24 URL:https://2.chacra.ceph.com/r/kernel/testing/5efacacc980658c97571abb0ce2f1ffc0c242411/centos/8/flavors/default/x86_64/kernel-5.18.0_rc4_ceph_g5efacacc9806-1.x86_64.rpm [45221864/45221864] -> "/tmp/kernel.x86_64.rpm" [1] 2022-05-02T09:29:24.829 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2022-05-02 09:29:24-- 2022-05-02T09:29:24.829 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 6.6s 2022-05-02T09:29:24.829 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 43M in 6.2s (6.92 MB/s) 2022-05-02T09:29:24.830 INFO:teuthology.task.kernel:Installing kernel 5efacacc980658c97571abb0ce2f1ffc0c242411 on client.0... 2022-05-02T09:29:24.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-05-02T09:29:25.304 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying... ######################################## 2022-05-02T09:29:25.651 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing... ######################################## 2022-05-02T09:29:25.667 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.18.0_rc4_ceph_g5efacacc9806-1######################################## 2022-05-02T09:29:25.779 INFO:teuthology.orchestra.run.smithi073.stdout:Updating / installing... 2022-05-02T09:29:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.18.0_rc4_ceph_g5efacacc9806-1######################################## 2022-05-02T09:29:36.001 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-05-02T09:29:36.001 DEBUG:teuthology.orchestra.run.smithi086:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:36.027 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/config-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/vmlinux-5.18.0-rc4-ceph-g5efacacc9806.bz2 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86 2022-05-02T09:29:36.028 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32c-intel.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-05-02T09:29:36.029 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx2.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-05-02T09:29:36.030 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-05-02T09:29:36.031 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel 2022-05-02T09:29:36.055 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu 2022-05-02T09:29:36.055 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-amd.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-intel.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ansi_cprng.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/anubis.ko 2022-05-02T09:29:36.056 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/arc4.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_memcpy.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_pq.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_raid6_recov.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_tx.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_xor.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/raid6test.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authenc.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authencesn.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blake2b_generic.ko 2022-05-02T09:29:36.057 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_common.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_generic.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/camellia_generic.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast5_generic.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast6_generic.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast_common.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ccm.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cmac.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crc32_generic.ko 2022-05-02T09:29:36.058 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_engine.ko 2022-05-02T09:29:36.059 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_user.ko 2022-05-02T09:29:36.059 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cts.ko 2022-05-02T09:29:36.059 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/des_generic.ko 2022-05-02T09:29:36.059 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/dh_generic.ko 2022-05-02T09:29:36.060 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/echainiv.ko 2022-05-02T09:29:36.061 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/essiv.ko 2022-05-02T09:29:36.062 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/fcrypt.ko 2022-05-02T09:29:36.064 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/khazad.ko 2022-05-02T09:29:36.064 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4hc.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/md4.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/michael_mic.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcbc.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcrypt.ko 2022-05-02T09:29:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/rmd160.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/seed.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/serpent_generic.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tcrypt.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tea.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_common.ko 2022-05-02T09:29:36.066 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_generic.ko 2022-05-02T09:29:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/vmac.ko 2022-05-02T09:29:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/wp512.ko 2022-05-02T09:29:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xcbc.ko 2022-05-02T09:29:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xor.ko 2022-05-02T09:29:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xxhash_generic.ko 2022-05-02T09:29:36.068 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers 2022-05-02T09:29:36.068 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi 2022-05-02T09:29:36.068 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_ipmi.ko 2022-05-02T09:29:36.068 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_pad.ko 2022-05-02T09:29:36.068 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/custom_method.ko 2022-05-02T09:29:36.069 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/ec_sys.ko 2022-05-02T09:29:36.069 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/platform_profile.ko 2022-05-02T09:29:36.069 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbs.ko 2022-05-02T09:29:36.069 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbshc.ko 2022-05-02T09:29:36.069 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/video.ko 2022-05-02T09:29:36.070 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata 2022-05-02T09:29:36.070 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/acard-ahci.ko 2022-05-02T09:29:36.070 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ahci_platform.ko 2022-05-02T09:29:36.070 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ata_generic.ko 2022-05-02T09:29:36.070 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/libahci_platform.ko 2022-05-02T09:29:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_acpi.ko 2022-05-02T09:29:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ali.ko 2022-05-02T09:29:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_amd.ko 2022-05-02T09:29:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_artop.ko 2022-05-02T09:29:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atiixp.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atp867x.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd640.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd64x.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cypress.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_efar.ko 2022-05-02T09:29:36.072 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt366.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt37x.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x2n.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x3.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it8213.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it821x.ko 2022-05-02T09:29:36.073 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_jmicron.ko 2022-05-02T09:29:36.074 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_marvell.ko 2022-05-02T09:29:36.074 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_mpiix.ko 2022-05-02T09:29:36.074 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_netcell.ko 2022-05-02T09:29:36.074 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ninja32.ko 2022-05-02T09:29:36.074 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87410.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87415.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_oldpiix.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_opti.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_optidma.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pcmcia.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc2027x.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-05-02T09:29:36.075 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_piccolo.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_rdc.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sch.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_serverworks.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sil680.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sis.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sl82c105.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_triflex.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_via.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pdc_adma.ko 2022-05-02T09:29:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_inic162x.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_mv.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_nv.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_promise.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_qstor.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil24.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sis.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_svw.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sx4.ko 2022-05-02T09:29:36.077 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_uli.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_via.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_vsc.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay/ks0108.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap/regmap-i2c.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma/bcma.ko 2022-05-02T09:29:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe/aoe.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/brd.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd/drbd.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/floppy.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/loop.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-05-02T09:29:36.079 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/nbd.ko 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk/null_blk.ko 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/pktcdvd.ko 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/rbd.ko 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/sx8.ko 2022-05-02T09:29:36.080 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/virtio_blk.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkfront.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram/zram.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hangcheck-timer.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/amd-rng.ko 2022-05-02T09:29:36.081 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/intel-rng.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/via-rng.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/virtio-rng.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_si.ko 2022-05-02T09:29:36.082 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/lp.ko 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave/mwave.ko 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-05-02T09:29:36.083 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ppdev.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tlclk.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_atmel.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_infineon.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_nsc.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-05-02T09:29:36.084 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/uv_mmtimer.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/virtio_console.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/p4-clockmod.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/powernow-k8.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/speedstep-lib.ko 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto 2022-05-02T09:29:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp.ko 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-aes.ko 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-sha.ko 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common 2022-05-02T09:29:36.086 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca/dca.ko 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma 2022-05-02T09:29:36.087 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw/dw_dmac.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat/ioatdma.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/amd64_edac.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/e752x_edac.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/edac_mce_amd.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3000_edac.ko 2022-05-02T09:29:36.088 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3200_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5000_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5100_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5400_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7300_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7core_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i82975x_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/ie31200_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/sb_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/x38_edac.ko 2022-05-02T09:29:36.089 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/edd.ko 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/iscsi_ibft.ko 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-ich.ko 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-viperboard.ko 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-appleir.ko 2022-05-02T09:29:36.090 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-aureal.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-axff.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-dr.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elecom.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elo.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-emsff.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gaff.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gt683r.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gyration.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-kbd.ko 2022-05-02T09:29:36.091 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-mouse.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtekff.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-hyperv.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-icade.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-keytouch.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-kye.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lcpower.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-led.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lenovo.ko 2022-05-02T09:29:36.092 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-dj.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-multitouch.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-ortek.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-penmount.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-petalynx.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-picolcd.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-pl.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-plantronics.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-primax.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-rmi.ko 2022-05-02T09:29:36.093 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-arvo.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-common.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-isku.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kone.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-konepure.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-lua.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-pyra.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-ryos.ko 2022-05-02T09:29:36.094 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-savu.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-saitek.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-samsung.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sensor-hub.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sjoy.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sony.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-speedlink.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-steelseries.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sunplus.ko 2022-05-02T09:29:36.095 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-thrustmaster.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tivo.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tmff.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-topseed.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-twinhan.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-uclogic.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-waltop.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-wiimote.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-xinmo.ko 2022-05-02T09:29:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zpff.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zydacron.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/uhid.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/wacom.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_balloon.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_utils.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_vmbus.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru.ko 2022-05-02T09:29:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru3.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/acpi_power_meter.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7414.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7418.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adc128d818.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1021.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1025.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1026.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1029.ko 2022-05-02T09:29:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1031.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm9240.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ads7828.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7410.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7411.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7462.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7470.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7475.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7x10.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/amc6821.ko 2022-05-02T09:29:36.099 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/applesmc.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asb100.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asc7621.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asus_atk0110.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/atxp1.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/coretemp.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-05-02T09:29:36.100 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dme1737.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds1621.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds620.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc1403.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc6w201.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71805f.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71882fg.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f75375s.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fam15h_power.ko 2022-05-02T09:29:36.101 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fschmd.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g760a.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g762.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl518sm.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl520sm.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/hwmon-vid.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5500_temp.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5k_amb.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmaem.ko 2022-05-02T09:29:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmpex.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina209.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina2xx.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/it87.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k10temp.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k8temp.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lineage-pem.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm63.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm73.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm75.ko 2022-05-02T09:29:36.103 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm77.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm78.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm80.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm83.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm85.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm87.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm90.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm92.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm93.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95234.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95241.ko 2022-05-02T09:29:36.104 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95245.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc2945.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4151.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4215.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4222.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4245.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4260.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4261.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max16065.ko 2022-05-02T09:29:36.105 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1619.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1668.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max197.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6639.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6642.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6650.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6697.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/mcp3021.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6683.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6775.ko 2022-05-02T09:29:36.106 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct7802.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87360.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87427.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pcf8591.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max16064.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max34440.ko 2022-05-02T09:29:36.107 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max8688.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/powr1220.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5627.ko 2022-05-02T09:29:36.108 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5636.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch56xx-common.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht15.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht21.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/shtc1.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sis5595.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47b397.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m1.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m192.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/thmc50.ko 2022-05-02T09:29:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp102.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp103.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp401.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp421.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via-cputemp.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via686a.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt1211.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt8231.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627ehf.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627hf.ko 2022-05-02T09:29:36.110 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83781d.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83791d.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83792d.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83793.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83795.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l785ts.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l786ng.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-05-02T09:29:36.111 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-05-02T09:29:36.112 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-i801.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-isch.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-parport.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-05-02T09:29:36.113 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-via.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-dev.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-mux.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-smbus.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-stub.ko 2022-05-02T09:29:36.114 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_cm.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_core.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_umad.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/iw_cm.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_cm.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4 2022-05-02T09:29:36.115 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib 2022-05-02T09:29:36.116 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport 2022-05-02T09:29:36.117 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/fm801-gp.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/gameport.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/lightning.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/ns558.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/joydev.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard/gpio_keys.ko 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse 2022-05-02T09:29:36.118 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/appletouch.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/bcm5974.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/cyapatp.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/elan_i2c.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/sermouse.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-05-02T09:29:36.119 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_usb.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/vsxxxaa.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4/rmi_core.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/altera_ps2.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/arc_ps2.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/serio_raw.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/sparse-keymap.ko 2022-05-02T09:29:36.120 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd/iommu_v2.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-blinkm.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-clevo-mail.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lm3530.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lp3944.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-ss4200.ko 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger 2022-05-02T09:29:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-05-02T09:29:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache/bcache.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-bio-prison.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache-smq.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-crypt.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-delay.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-flakey.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-log-userspace.ko 2022-05-02T09:29:36.123 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-multipath.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-queue-length.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-raid.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-round-robin.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-service-time.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-switch.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-thin-pool.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-verity.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/faulty.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/linear.ko 2022-05-02T09:29:36.124 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/multipath.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid0.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid1.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid10.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid456.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptbase.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptctl.ko 2022-05-02T09:29:36.125 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptfc.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptlan.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptsas.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptscsih.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptspi.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_ich.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_sch.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/mfd-core.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/sm501.ko 2022-05-02T09:29:36.126 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/viperboard.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/vx855.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/wl1273-core.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds9802als.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds990x.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/bh1770glc.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710/cb710.ko 2022-05-02T09:29:36.127 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/at24.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/max6875.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/enclosure.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/hpilo.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29003.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29020.ko 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d 2022-05-02T09:29:36.128 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-me.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-txe.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru/gru.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xp.ko 2022-05-02T09:29:36.129 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpc.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_7xx1.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_core.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tsl2550.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_balloon.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net 2022-05-02T09:29:36.130 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding/bonding.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53/b53_common.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/bcm-sf2.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6060.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dummy.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/eql.ko 2022-05-02T09:29:36.131 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/8390.ko 2022-05-02T09:29:36.132 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere/et131x.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-05-02T09:29:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c 2022-05-02T09:29:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom 2022-05-02T09:29:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet 2022-05-02T09:29:36.136 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio 2022-05-02T09:29:36.137 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-05-02T09:29:36.138 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-05-02T09:29:36.139 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-05-02T09:29:36.139 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-05-02T09:29:36.139 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-05-02T09:29:36.139 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco 2022-05-02T09:29:36.139 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic 2022-05-02T09:29:36.140 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-05-02T09:29:36.140 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec 2022-05-02T09:29:36.140 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip 2022-05-02T09:29:36.140 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-05-02T09:29:36.140 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-05-02T09:29:36.141 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-05-02T09:29:36.141 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-05-02T09:29:36.141 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-05-02T09:29:36.141 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-05-02T09:29:36.141 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-05-02T09:29:36.142 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink 2022-05-02T09:29:36.142 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-05-02T09:29:36.142 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-05-02T09:29:36.142 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dnet.ko 2022-05-02T09:29:36.142 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex 2022-05-02T09:29:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet 2022-05-02T09:29:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-05-02T09:29:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ethoc.ko 2022-05-02T09:29:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/fealnx.ko 2022-05-02T09:29:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e100.ko 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-05-02T09:29:36.144 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-05-02T09:29:36.145 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/jme.ko 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-05-02T09:29:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/skge.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-05-02T09:29:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-05-02T09:29:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-05-02T09:29:36.149 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/atp.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-05-02T09:29:36.150 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis190.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis900.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-05-02T09:29:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/cassini.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/niu.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sungem.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti 2022-05-02T09:29:36.152 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti/tlan.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom 2022-05-02T09:29:36.153 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/geneve.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154/fakelb.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ifb.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan/ipvlan.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvlan.ko 2022-05-02T09:29:36.154 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvtap.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mii.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/net_failover.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/netconsole.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/nlmon.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-05-02T09:29:36.155 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/amd.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm7xxx.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm87xx.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/broadcom.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/cicada.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/davicom.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/dp83640.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/et1011c.ko 2022-05-02T09:29:36.156 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/icplus.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/lxt.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/marvell.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/micrel.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/national.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/phylink.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/qsemi.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/realtek.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/smsc.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/ste10Xp.ko 2022-05-02T09:29:36.157 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/vitesse.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/bsd_comp.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_async.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_deflate.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_generic.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_mppe.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_synctty.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppoe.ko 2022-05-02T09:29:36.158 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppox.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pptp.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slhc.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slip.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/sungem_phy.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tap.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_activebackup.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_broadcast.ko 2022-05-02T09:29:36.159 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_random.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tun.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/veth.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/virtio_net.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan/vxlan.ko 2022-05-02T09:29:36.160 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback/xen-netback.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netfront.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb/ntb.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme-core.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport.ko 2022-05-02T09:29:36.161 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_cs.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_pc.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_serial.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie/aer_inject.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/xen-pcifront.ko 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia 2022-05-02T09:29:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/i82092.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/pd6729.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/yenta_socket.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acer-wmi.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acerhdf.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/apple-gmux.ko 2022-05-02T09:29:36.163 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-laptop.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-wmi.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/classmate-laptop.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hdaps.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp-wmi.ko 2022-05-02T09:29:36.164 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp_accel.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel_ips.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/msi-wmi.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/mxm-wmi.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-laptop.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-q10.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/topstar-laptop.ko 2022-05-02T09:29:36.165 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_haps.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi-bmof.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_common.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_msr.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-gpio.ko 2022-05-02T09:29:36.166 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-ldisc.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps_parport.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/pps_core.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp_kvm.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq32k.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq4802.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1286.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1307.ko 2022-05-02T09:29:36.167 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1374.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1511.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1553.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1672.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1742.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds2404.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds3232.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-em3027.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-fm3130.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl12022.ko 2022-05-02T09:29:36.168 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl1208.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m41t80.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t35.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t59.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-max6900.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-msm6242.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf2127.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf85063.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8523.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8563.ko 2022-05-02T09:29:36.169 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8583.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rp5c01.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rs5c372.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8025.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8581.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-v3020.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-x1205.ko 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi 2022-05-02T09:29:36.170 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-9xxx.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-sas.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-xxxx.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/BusLogic.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/a100u2w.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid/aacraid.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/advansys.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-05-02T09:29:36.171 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/am53c974.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/atp870u.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa/bfa.ko 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc 2022-05-02T09:29:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ch.ko 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor/csiostor.ko 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i 2022-05-02T09:29:36.173 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dc395x.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dmx3191d.ko 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r 2022-05-02T09:29:36.174 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r/esas2r.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esp_scsi.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/fcoe.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic/fnic.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hpsa.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hptiop.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hv_storvsc.ko 2022-05-02T09:29:36.175 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/initio.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ipr.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ips.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci/isci.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_tcp.ko 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc 2022-05-02T09:29:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc/libfc.ko 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi.ko 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi_tcp.ko 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas/libsas.ko 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc/lpfc.ko 2022-05-02T09:29:36.177 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas/mvsas.ko 2022-05-02T09:29:36.178 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvumi.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pmcraid.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla1280.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-05-02T09:29:36.179 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx 2022-05-02T09:29:36.180 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-05-02T09:29:36.180 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/raid_class.ko 2022-05-02T09:29:36.182 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_debug.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_fc.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_sas.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_spi.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_srp.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ses.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/st.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/stex.ko 2022-05-02T09:29:36.183 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/virtio_scsi.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/vmw_pvscsi.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/wd719x.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb/ssb.ko 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target 2022-05-02T09:29:36.184 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback/tcm_loop.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_file.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_iblock.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_mod.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_pscsi.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_user.ko 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc 2022-05-02T09:29:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-05-02T09:29:36.186 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty 2022-05-02T09:29:36.187 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_gsm.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_hdlc.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/nozomi.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/arc_uart.ko 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm 2022-05-02T09:29:36.188 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm/jsm.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/synclink_gt.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_aec.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_cif.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_pci_generic.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_sercos3.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-acm.ko 2022-05-02T09:29:36.189 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-wdm.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usblp.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usbtmc.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/sl811-hcd.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/u132-hcd.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/mdc800.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/microtek.ko 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc 2022-05-02T09:29:36.190 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/adutux.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/appledisplay.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi26.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi62.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ezusb.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ftdi-elan.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/idmouse.ko 2022-05-02T09:29:36.191 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/iowarrior.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/isight_firmware.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ldusb.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/legousbtower.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/trancevibrator.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usb3503.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usblcd.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usbsevseg.ko 2022-05-02T09:29:36.192 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/uss720.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/yurex.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy/phy-generic.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/aircable.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ark3116.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/belkin_sa.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ch341.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cp210x.ko 2022-05-02T09:29:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cyberjack.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cypress_m8.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/digi_acceleport.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/empeg.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ftdi_sio.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/garmin_gps.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_edgeport.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_ti.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipaq.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipw.ko 2022-05-02T09:29:36.194 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ir-usb.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan_pda.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kl5kusb105.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kobil_sct.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mct_u232.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7720.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7840.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/navman.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/omninet.ko 2022-05-02T09:29:36.195 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/opticon.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/option.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/oti6858.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/pl2303.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcaux.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcserial.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/quatech2.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/safe_serial.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/sierra.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/spcp8x5.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ssu100.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/symbolserial.ko 2022-05-02T09:29:36.196 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_debug.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_wwan.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/visor.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/whiteheat.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/xsens_mt.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/uas.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-alauda.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-cypress.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-datafab.ko 2022-05-02T09:29:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-freecom.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-isd200.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-karma.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-onetouch.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-realtek.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr09.ko 2022-05-02T09:29:36.198 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr55.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-usbat.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/usb-storage.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-core.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-host.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-05-02T09:29:36.199 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_virqfd.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_iotlb.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_net.ko 2022-05-02T09:29:36.200 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_scsi.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/apple_bl.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/lcd.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/platform_lcd.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_balloon.ko 2022-05-02T09:29:36.201 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_mmio.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_ring.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds1wm.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2482.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2490.ko 2022-05-02T09:29:36.202 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-05-02T09:29:36.203 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_smem.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_therm.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/wire.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim1535_wdt.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim7101_wdt.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/f71808e_wdt.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/hpwdt.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/i6300esb.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_wdt.ko 2022-05-02T09:29:36.204 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ib700wdt.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ibmasr.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it8712f_wdt.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it87_wdt.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/machzwd.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/nv_tco.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_pci.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_usb.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-05-02T09:29:36.205 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sch311x_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/softdog.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sp5100_tco.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/via_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83877f_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83977f_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/wdt_pci.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/xen_wdt.ko 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen 2022-05-02T09:29:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-acpi-processor.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-evtchn.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntalloc.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntdev.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-privcmd.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs/xenfs.ko 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs 2022-05-02T09:29:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p/9p.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs/affs.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs/befs.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/binfmt_misc.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs/btrfs.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles/cachefiles.ko 2022-05-02T09:29:36.208 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph 2022-05-02T09:29:36.209 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph/ceph.ko 2022-05-02T09:29:36.209 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs 2022-05-02T09:29:36.209 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs/cifs.ko 2022-05-02T09:29:36.209 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda 2022-05-02T09:29:36.209 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda/coda.ko 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs/cramfs.ko 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm/dlm.ko 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs/ecryptfs.ko 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs/f2fs.ko 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat 2022-05-02T09:29:36.210 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/fat.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/msdos.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/vfat.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache/fscache.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/cuse.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/fuse.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2/gfs2.ko 2022-05-02T09:29:36.211 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs/hfs.ko 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus/hfsplus.ko 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs/isofs.ko 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs/jfs.ko 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd/lockd.ko 2022-05-02T09:29:36.212 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix/minix.ko 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs/netfs.ko 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-05-02T09:29:36.213 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfs.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv3.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv4.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/grace.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/nfs_acl.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd/nfsd.ko 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2 2022-05-02T09:29:36.214 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2/nilfs2.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-celtic.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-centeuro.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-croatian.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-cyrillic.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-gaelic.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-greek.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-iceland.ko 2022-05-02T09:29:36.215 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-inuit.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-roman.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-romanian.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-turkish.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1250.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1251.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1255.ko 2022-05-02T09:29:36.216 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp737.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp775.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp850.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp852.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp855.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp857.ko 2022-05-02T09:29:36.217 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp860.ko 2022-05-02T09:29:36.218 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp861.ko 2022-05-02T09:29:36.218 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp862.ko 2022-05-02T09:29:36.218 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp863.ko 2022-05-02T09:29:36.218 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp864.ko 2022-05-02T09:29:36.218 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp865.ko 2022-05-02T09:29:36.219 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp866.ko 2022-05-02T09:29:36.219 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp869.ko 2022-05-02T09:29:36.219 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp874.ko 2022-05-02T09:29:36.219 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp932.ko 2022-05-02T09:29:36.220 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp936.ko 2022-05-02T09:29:36.220 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp949.ko 2022-05-02T09:29:36.220 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp950.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_euc-jp.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-1.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-13.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-14.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-15.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-2.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-3.ko 2022-05-02T09:29:36.221 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-4.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-5.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-6.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-7.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-9.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-r.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-ru.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-u.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_utf8.ko 2022-05-02T09:29:36.222 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-05-02T09:29:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs/overlay.ko 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore/ramoops.ko 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs/reiserfs.ko 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs/romfs.ko 2022-05-02T09:29:36.224 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_arc4.ko 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_md4.ko 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs/squashfs.ko 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv/sysv.ko 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf/udf.ko 2022-05-02T09:29:36.225 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs/ufs.ko 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs/xfs.ko 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu/rcutorture.ko 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/torture.ko 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace 2022-05-02T09:29:36.226 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/asn1_encoder.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc-itu-t.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc8.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libarc4.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libdes.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/libcrc32c.ko 2022-05-02T09:29:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lru_cache.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4_compress.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4hc_compress.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math/cordic.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6/raid6_pq.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon/reed_solomon.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_bm.ko 2022-05-02T09:29:36.228 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_fsm.ko 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_kmp.ko 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd/zstd_compress.ko 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm/hwpoison-inject.ko 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/6lowpan.ko 2022-05-02T09:29:36.229 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_dest.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_fragment.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_hop.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_ipv6.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_mobility.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_routing.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_udp.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/garp.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/mrp.ko 2022-05-02T09:29:36.230 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/p8022.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/psnap.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/stp.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q/8021q.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_fd.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_rdma.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_virtio.ko 2022-05-02T09:29:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv/batman-adv.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/br_netfilter.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/bridge.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_among.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arp.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-05-02T09:29:36.232 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_limit.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_log.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_snat.ko 2022-05-02T09:29:36.233 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_stp.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtables.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph/libceph.ko 2022-05-02T09:29:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/failover.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/pktgen.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_diag.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv4.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv6.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver/dns_resolver.ko 2022-05-02T09:29:36.235 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/dsa_core.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_brcm.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_dsa.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_trailer.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154_socket.ko 2022-05-02T09:29:36.236 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ah4.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/esp4.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/fou.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/gre.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/inet_diag.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_gre.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_tunnel.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_vti.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipcomp.ko 2022-05-02T09:29:36.237 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipip.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arp_tables.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-05-02T09:29:36.238 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_security.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-05-02T09:29:36.239 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_bic.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_dctcp.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_diag.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_highspeed.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_htcp.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_hybla.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_illinois.ko 2022-05-02T09:29:36.240 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_lp.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_scalable.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_vegas.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_veno.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_westwood.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_yeah.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tunnel4.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_diag.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_tunnel.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/xfrm4_tunnel.ko 2022-05-02T09:29:36.241 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ah6.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/esp6.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/fou6.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_tunnel.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_vti.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ipcomp6.ko 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter 2022-05-02T09:29:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-05-02T09:29:36.243 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-05-02T09:29:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-05-02T09:29:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/sit.ko 2022-05-02T09:29:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/tunnel6.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/xfrm6_tunnel.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key/af_key.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_core.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_debugfs.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_eth.ko 2022-05-02T09:29:36.247 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip6.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_netlink.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ppp.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc/llc.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154/mac802154.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls/mpls_gso.ko 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter 2022-05-02T09:29:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-05-02T09:29:36.249 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-05-02T09:29:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-05-02T09:29:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conncount.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_h323.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_irc.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-05-02T09:29:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sane.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sip.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_dup_netdev.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table_inet.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_log_syslog.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat.ko 2022-05-02T09:29:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_amanda.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_ftp.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_irc.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_sip.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_tftp.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_synproxy_core.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_tables.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_acct.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_log.ko 2022-05-02T09:29:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_osf.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_queue.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_chain_nat.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_compat.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_ct.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_dup_netdev.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fib.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fwd_netdev.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_hash.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_limit.ko 2022-05-02T09:29:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_log.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_masq.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_nat.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_numgen.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_objref.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_queue.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_quota.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_redir.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject_inet.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_socket.ko 2022-05-02T09:29:36.256 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_tunnel.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_AUDIT.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CHECKSUM.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CLASSIFY.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CT.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_DSCP.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HL.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HMARK.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_IDLETIMER.ko 2022-05-02T09:29:36.257 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LED.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LOG.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_MASQUERADE.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NETMAP.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFLOG.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFQUEUE.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_RATEEST.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_REDIRECT.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_SECMARK.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPMSS.ko 2022-05-02T09:29:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TEE.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TPROXY.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TRACE.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_addrtype.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_bpf.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cgroup.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cluster.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_comment.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connbytes.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlabel.ko 2022-05-02T09:29:36.259 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlimit.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connmark.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_conntrack.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cpu.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dccp.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_devgroup.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dscp.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ecn.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_esp.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hashlimit.ko 2022-05-02T09:29:36.260 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_helper.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hl.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipcomp.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_iprange.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipvs.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_l2tp.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_length.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_limit.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mac.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mark.ko 2022-05-02T09:29:36.261 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_multiport.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nat.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nfacct.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_osf.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_owner.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_physdev.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_pkttype.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_policy.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_quota.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_rateest.ko 2022-05-02T09:29:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_realm.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_recent.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_sctp.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_set.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_socket.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_state.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_statistic.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_string.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_tcpmss.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_time.ko 2022-05-02T09:29:36.263 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_u32.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink/netlink_diag.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh/nsh.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/openvswitch.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-geneve.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-gre.ko 2022-05-02T09:29:36.264 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-vxlan.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet/af_packet_diag.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_rdma.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_tcp.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_csum.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_gact.ko 2022-05-02T09:29:36.265 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_ipt.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_mirred.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_nat.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_pedit.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_police.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_simple.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_skbedit.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_vlan.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_basic.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_bpf.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_flow.ko 2022-05-02T09:29:36.266 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_fw.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_route.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp6.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_tcindex.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_u32.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_cmp.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_ipset.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_meta.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_nbyte.ko 2022-05-02T09:29:36.267 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_text.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_u32.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_cbq.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_choke.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_codel.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_drr.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_dsmark.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_fq.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_gred.ko 2022-05-02T09:29:36.268 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hfsc.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hhf.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_htb.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_ingress.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_mqprio.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_multiq.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_netem.ko 2022-05-02T09:29:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_pie.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_plug.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_prio.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_qfq.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_red.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfb.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfq.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_tbf.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_teql.ko 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp 2022-05-02T09:29:36.270 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp_diag.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/sunrpc.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc 2022-05-02T09:29:36.271 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/diag.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/tipc.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix/unix_diag.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_diag.ko 2022-05-02T09:29:36.272 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_loopback.ko 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm/xfrm_ipcomp.ko 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys/trusted.ko 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt 2022-05-02T09:29:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib/irqbypass.ko 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias.bin 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.bin 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.modinfo 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep.bin 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.devname 2022-05-02T09:29:36.274 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.order 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.softdep 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols.bin 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/.build-id 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/.build-id/7c 2022-05-02T09:29:36.275 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/.build-id/7c/b5ca1425e9c48e922494125ed420c3d674fa67 2022-05-02T09:29:36.276 DEBUG:teuthology.task.kernel:get_image_version: 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.276 DEBUG:teuthology.orchestra.run.smithi086:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:36.300 INFO:teuthology.orchestra.run.smithi086.stdout:postinstall scriptlet (using /bin/sh): 2022-05-02T09:29:36.300 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 -a -r /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 ]; then 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:cp /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:cp /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:rm -f /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/installkernel 5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:rm -f /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:preuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-05-02T09:29:36.301 INFO:teuthology.orchestra.run.smithi086.stdout:new-kernel-pkg --remove 5.18.0-rc4-ceph-g5efacacc9806 --rminitrd --initrdfile=/boot/initramfs-5.18.0-rc4-ceph-g5efacacc9806.img 2022-05-02T09:29:36.302 INFO:teuthology.orchestra.run.smithi086.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-05-02T09:29:36.302 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-install remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.302 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2022-05-02T09:29:36.303 INFO:teuthology.orchestra.run.smithi086.stdout:postuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:36.303 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/update-bootloader ]; then 2022-05-02T09:29:36.303 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/update-bootloader --remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.303 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2022-05-02T09:29:36.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2022-05-02T09:29:36.373 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2022-05-02T09:29:36.373 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2022-05-02T09:29:36.373 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.02 2022-05-02T09:29:36.373 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 123.el8 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Sun 01 May 2022 12:17:57 PM UTC 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:Group : System Environment/Base 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 9265449 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2022-05-02T09:29:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Tue 05 Apr 2022 04:12:58 PM UTC, Key ID 05b555b38483c65d 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Tue 05 Apr 2022 03:27:44 PM UTC 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : kbuilder.bsys.centos.org 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Relocations : (not relocatable) 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : CentOS BuildSystem 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2022-05-02T09:29:36.375 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2022-05-02T09:29:36.376 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:29:36.377 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2022-05-02T09:29:36.378 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-05-02T09:29:36.378 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:36.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-05-02T09:29:38.344 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-05-02T09:29:38.344 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinux-5.18.0-rc4-ceph-g5efacacc9806.bz2 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel 2022-05-02T09:29:38.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-05-02T09:29:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32c-intel.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx2.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-05-02T09:29:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-amd.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-intel.ko 2022-05-02T09:29:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ansi_cprng.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/anubis.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/arc4.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_memcpy.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_pq.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_raid6_recov.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_tx.ko 2022-05-02T09:29:38.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_xor.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/raid6test.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authenc.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authencesn.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blake2b_generic.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_common.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_generic.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/camellia_generic.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast5_generic.ko 2022-05-02T09:29:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast6_generic.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast_common.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ccm.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cmac.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crc32_generic.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_engine.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_user.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cts.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/des_generic.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/dh_generic.ko 2022-05-02T09:29:38.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/echainiv.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/essiv.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/fcrypt.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/khazad.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4hc.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/md4.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/michael_mic.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcbc.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcrypt.ko 2022-05-02T09:29:38.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/rmd160.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/seed.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/serpent_generic.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tcrypt.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tea.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_common.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_generic.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/vmac.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/wp512.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xcbc.ko 2022-05-02T09:29:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xor.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xxhash_generic.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_ipmi.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_pad.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/custom_method.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/ec_sys.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/platform_profile.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbs.ko 2022-05-02T09:29:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbshc.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/video.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/acard-ahci.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ahci_platform.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ata_generic.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/libahci_platform.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_acpi.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ali.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_amd.ko 2022-05-02T09:29:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_artop.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atiixp.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atp867x.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd640.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd64x.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cypress.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_efar.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt366.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt37x.ko 2022-05-02T09:29:38.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x2n.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x3.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it8213.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it821x.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_jmicron.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_marvell.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_mpiix.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_netcell.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ninja32.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87410.ko 2022-05-02T09:29:38.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87415.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_oldpiix.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_opti.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_optidma.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pcmcia.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc2027x.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_piccolo.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_rdc.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sch.ko 2022-05-02T09:29:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_serverworks.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sil680.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sis.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sl82c105.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_triflex.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_via.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pdc_adma.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_inic162x.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_mv.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_nv.ko 2022-05-02T09:29:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_promise.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_qstor.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil24.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sis.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_svw.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sx4.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_uli.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_via.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_vsc.ko 2022-05-02T09:29:38.428 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay/ks0108.ko 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap/regmap-i2c.ko 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma/bcma.ko 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe/aoe.ko 2022-05-02T09:29:38.429 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/brd.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd/drbd.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/floppy.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/loop.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/nbd.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk/null_blk.ko 2022-05-02T09:29:38.430 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/pktcdvd.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/rbd.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/sx8.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/virtio_blk.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkfront.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram/zram.ko 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char 2022-05-02T09:29:38.431 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hangcheck-timer.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/amd-rng.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/intel-rng.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/via-rng.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/virtio-rng.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-05-02T09:29:38.432 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_si.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/lp.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave/mwave.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-05-02T09:29:38.433 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ppdev.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tlclk.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_atmel.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_infineon.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_nsc.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-05-02T09:29:38.434 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/uv_mmtimer.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/virtio_console.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/p4-clockmod.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/powernow-k8.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/speedstep-lib.ko 2022-05-02T09:29:38.435 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp.ko 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-aes.ko 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-sha.ko 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc 2022-05-02T09:29:38.436 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca/dca.ko 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw/dw_dmac.ko 2022-05-02T09:29:38.437 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat/ioatdma.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/amd64_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/e752x_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/edac_mce_amd.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3000_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3200_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5000_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5100_edac.ko 2022-05-02T09:29:38.438 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5400_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7300_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7core_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i82975x_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/ie31200_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/sb_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/x38_edac.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/edd.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/iscsi_ibft.ko 2022-05-02T09:29:38.439 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-ich.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-viperboard.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-appleir.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-aureal.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-axff.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-dr.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elecom.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elo.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-emsff.ko 2022-05-02T09:29:38.440 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gaff.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gt683r.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gyration.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-kbd.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-mouse.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtekff.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-hyperv.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-icade.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-keytouch.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-kye.ko 2022-05-02T09:29:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lcpower.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-led.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lenovo.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-dj.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-multitouch.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-ortek.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-penmount.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-petalynx.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-picolcd.ko 2022-05-02T09:29:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-pl.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-plantronics.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-primax.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-rmi.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-arvo.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-common.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-isku.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kone.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-konepure.ko 2022-05-02T09:29:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-lua.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-pyra.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-ryos.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-savu.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-saitek.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-samsung.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sensor-hub.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sjoy.ko 2022-05-02T09:29:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sony.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-speedlink.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-steelseries.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sunplus.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-thrustmaster.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tivo.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tmff.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-topseed.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-twinhan.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-uclogic.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-waltop.ko 2022-05-02T09:29:38.445 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-wiimote.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-xinmo.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zpff.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zydacron.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/uhid.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/wacom.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_balloon.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_utils.ko 2022-05-02T09:29:38.446 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_vmbus.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru3.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/acpi_power_meter.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7414.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7418.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adc128d818.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1021.ko 2022-05-02T09:29:38.447 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1025.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1026.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1029.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1031.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm9240.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ads7828.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7410.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7411.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7462.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7470.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7475.ko 2022-05-02T09:29:38.448 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7x10.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/amc6821.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/applesmc.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asb100.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asc7621.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asus_atk0110.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/atxp1.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/coretemp.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-05-02T09:29:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dme1737.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds1621.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds620.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc1403.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc6w201.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71805f.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71882fg.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f75375s.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fam15h_power.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fschmd.ko 2022-05-02T09:29:38.450 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g760a.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g762.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl518sm.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl520sm.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/hwmon-vid.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5500_temp.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5k_amb.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmaem.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmpex.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina209.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina2xx.ko 2022-05-02T09:29:38.451 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/it87.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k10temp.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k8temp.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lineage-pem.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm63.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm73.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm75.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm77.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm78.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm80.ko 2022-05-02T09:29:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm83.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm85.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm87.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm90.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm92.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm93.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95234.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95241.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95245.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc2945.ko 2022-05-02T09:29:38.453 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4151.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4215.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4222.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4245.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4260.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4261.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max16065.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1619.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1668.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max197.ko 2022-05-02T09:29:38.454 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6639.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6642.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6650.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6697.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/mcp3021.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6683.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6775.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct7802.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87360.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87427.ko 2022-05-02T09:29:38.455 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pcf8591.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max16064.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max34440.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max8688.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-05-02T09:29:38.456 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/powr1220.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5627.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5636.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch56xx-common.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht15.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht21.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/shtc1.ko 2022-05-02T09:29:38.457 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sis5595.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47b397.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m1.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m192.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/thmc50.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp102.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp103.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp401.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp421.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via-cputemp.ko 2022-05-02T09:29:38.458 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via686a.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt1211.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt8231.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627ehf.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627hf.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83781d.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83791d.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83792d.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83793.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83795.ko 2022-05-02T09:29:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l785ts.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l786ng.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-05-02T09:29:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-i801.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-isch.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-05-02T09:29:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-parport.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-via.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-05-02T09:29:38.462 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-dev.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-mux.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-smbus.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-stub.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_cm.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_core.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_umad.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-05-02T09:29:38.463 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/iw_cm.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_cm.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-05-02T09:29:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp 2022-05-02T09:29:38.465 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/fm801-gp.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/gameport.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/lightning.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/ns558.ko 2022-05-02T09:29:38.466 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/joydev.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard/gpio_keys.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/appletouch.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/bcm5974.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/cyapatp.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/elan_i2c.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/sermouse.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-05-02T09:29:38.467 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_usb.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/vsxxxaa.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4/rmi_core.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/altera_ps2.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/arc_ps2.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/serio_raw.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/sparse-keymap.ko 2022-05-02T09:29:38.468 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd/iommu_v2.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-blinkm.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-clevo-mail.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lm3530.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lp3944.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-ss4200.ko 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger 2022-05-02T09:29:38.469 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md 2022-05-02T09:29:38.470 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache/bcache.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-bio-prison.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache-smq.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-crypt.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-delay.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-flakey.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-log-userspace.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-multipath.ko 2022-05-02T09:29:38.471 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-queue-length.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-raid.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-round-robin.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-service-time.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-switch.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-thin-pool.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-verity.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/faulty.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/linear.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/multipath.ko 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data 2022-05-02T09:29:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid0.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid1.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid10.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid456.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptbase.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptctl.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptfc.ko 2022-05-02T09:29:38.473 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptlan.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptsas.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptscsih.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptspi.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_ich.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_sch.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/mfd-core.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/sm501.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/viperboard.ko 2022-05-02T09:29:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/vx855.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/wl1273-core.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds9802als.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds990x.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/bh1770glc.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710/cb710.ko 2022-05-02T09:29:38.475 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/at24.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/max6875.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/enclosure.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/hpilo.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29003.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29020.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-05-02T09:29:38.476 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-me.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-txe.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru/gru.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xp.ko 2022-05-02T09:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpc.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_7xx1.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_core.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tsl2550.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_balloon.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-05-02T09:29:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding/bonding.ko 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53/b53_common.ko 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/bcm-sf2.ko 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6060.ko 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-05-02T09:29:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dummy.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/eql.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/8390.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-05-02T09:29:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere/et131x.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-05-02T09:29:38.481 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e 2022-05-02T09:29:38.482 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-05-02T09:29:38.483 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-05-02T09:29:38.484 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-05-02T09:29:38.485 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink 2022-05-02T09:29:38.486 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dnet.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ethoc.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/fealnx.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e100.ko 2022-05-02T09:29:38.487 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-05-02T09:29:38.488 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-05-02T09:29:38.489 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/jme.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/skge.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5 2022-05-02T09:29:38.490 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-05-02T09:29:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-05-02T09:29:38.492 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-05-02T09:29:38.493 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/atp.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis190.ko 2022-05-02T09:29:38.494 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis900.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-05-02T09:29:38.495 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/cassini.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/niu.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sungem.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti/tlan.ko 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via 2022-05-02T09:29:38.496 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/geneve.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-05-02T09:29:38.497 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154/fakelb.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ifb.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan/ipvlan.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvlan.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvtap.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-05-02T09:29:38.498 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mii.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/net_failover.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/netconsole.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/nlmon.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/amd.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-05-02T09:29:38.499 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm7xxx.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm87xx.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/broadcom.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/cicada.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/davicom.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/dp83640.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/et1011c.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/icplus.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/lxt.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/marvell.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/micrel.ko 2022-05-02T09:29:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/national.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/phylink.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/qsemi.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/realtek.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/smsc.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/ste10Xp.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/vitesse.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/bsd_comp.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_async.ko 2022-05-02T09:29:38.501 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_deflate.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_generic.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_mppe.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_synctty.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppoe.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppox.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pptp.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slhc.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slip.ko 2022-05-02T09:29:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/sungem_phy.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tap.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_activebackup.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_broadcast.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_random.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tun.ko 2022-05-02T09:29:38.503 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/veth.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/virtio_net.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan/vxlan.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback/xen-netback.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netfront.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb/ntb.ko 2022-05-02T09:29:38.504 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme-core.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_cs.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_pc.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_serial.ko 2022-05-02T09:29:38.505 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie/aer_inject.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/xen-pcifront.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/i82092.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/pd6729.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/yenta_socket.ko 2022-05-02T09:29:38.506 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acer-wmi.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acerhdf.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/apple-gmux.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-laptop.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-05-02T09:29:38.507 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-wmi.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/classmate-laptop.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hdaps.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp-wmi.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp_accel.ko 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel 2022-05-02T09:29:38.508 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel_ips.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/msi-wmi.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/mxm-wmi.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-laptop.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-q10.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/topstar-laptop.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_haps.ko 2022-05-02T09:29:38.509 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi-bmof.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_common.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_msr.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-gpio.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-ldisc.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps_parport.ko 2022-05-02T09:29:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/pps_core.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp_kvm.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq32k.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq4802.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1286.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1307.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1374.ko 2022-05-02T09:29:38.511 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1511.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1553.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1672.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1742.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds2404.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds3232.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-em3027.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-fm3130.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl12022.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl1208.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m41t80.ko 2022-05-02T09:29:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t35.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t59.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-max6900.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-msm6242.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf2127.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf85063.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8523.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8563.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8583.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rp5c01.ko 2022-05-02T09:29:38.513 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rs5c372.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8025.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8581.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-v3020.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-x1205.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-9xxx.ko 2022-05-02T09:29:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-sas.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-xxxx.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/BusLogic.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/a100u2w.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid/aacraid.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/advansys.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/am53c974.ko 2022-05-02T09:29:38.515 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/atp870u.ko 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa/bfa.ko 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i 2022-05-02T09:29:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ch.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor/csiostor.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dc395x.ko 2022-05-02T09:29:38.517 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dmx3191d.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r/esas2r.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esp_scsi.ko 2022-05-02T09:29:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/fcoe.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic/fnic.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hpsa.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hptiop.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hv_storvsc.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/initio.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ipr.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ips.ko 2022-05-02T09:29:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci/isci.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_tcp.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc/libfc.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi_tcp.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas/libsas.ko 2022-05-02T09:29:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc/lpfc.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas 2022-05-02T09:29:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas/mvsas.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvumi.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pmcraid.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla1280.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-05-02T09:29:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/raid_class.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_debug.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_fc.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_sas.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_spi.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_srp.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ses.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/st.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/stex.ko 2022-05-02T09:29:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/virtio_scsi.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/vmw_pvscsi.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/wd719x.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb/ssb.ko 2022-05-02T09:29:38.524 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback/tcm_loop.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_file.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_iblock.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_mod.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_pscsi.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_user.ko 2022-05-02T09:29:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-05-02T09:29:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-05-02T09:29:38.527 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_gsm.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_hdlc.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/nozomi.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/arc_uart.ko 2022-05-02T09:29:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm/jsm.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/synclink_gt.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_aec.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_cif.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_pci_generic.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_sercos3.ko 2022-05-02T09:29:38.529 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-acm.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-wdm.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usblp.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usbtmc.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/sl811-hcd.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/u132-hcd.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/mdc800.ko 2022-05-02T09:29:38.530 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/microtek.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/adutux.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/appledisplay.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi26.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi62.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ezusb.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ftdi-elan.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/idmouse.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/iowarrior.ko 2022-05-02T09:29:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/isight_firmware.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ldusb.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/legousbtower.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/trancevibrator.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usb3503.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usblcd.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usbsevseg.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/uss720.ko 2022-05-02T09:29:38.532 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/yurex.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy/phy-generic.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/aircable.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ark3116.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/belkin_sa.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ch341.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cp210x.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cyberjack.ko 2022-05-02T09:29:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cypress_m8.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/digi_acceleport.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/empeg.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ftdi_sio.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/garmin_gps.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_edgeport.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_ti.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipaq.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipw.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ir-usb.ko 2022-05-02T09:29:38.534 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan_pda.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kl5kusb105.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kobil_sct.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mct_u232.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7720.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7840.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/navman.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/omninet.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/opticon.ko 2022-05-02T09:29:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/option.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/oti6858.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/pl2303.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcaux.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcserial.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/quatech2.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/safe_serial.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/sierra.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/spcp8x5.ko 2022-05-02T09:29:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ssu100.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/symbolserial.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_debug.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_wwan.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/visor.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/whiteheat.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/xsens_mt.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/uas.ko 2022-05-02T09:29:38.537 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-alauda.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-cypress.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-datafab.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-freecom.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-isd200.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-karma.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-onetouch.ko 2022-05-02T09:29:38.538 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-realtek.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr09.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr55.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-usbat.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/usb-storage.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-core.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-host.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio 2022-05-02T09:29:38.539 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_virqfd.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_iotlb.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_net.ko 2022-05-02T09:29:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_scsi.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/apple_bl.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/lcd.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/platform_lcd.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_balloon.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_mmio.ko 2022-05-02T09:29:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_ring.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds1wm.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2482.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2490.ko 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves 2022-05-02T09:29:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-05-02T09:29:38.543 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_smem.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_therm.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/wire.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim1535_wdt.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim7101_wdt.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/f71808e_wdt.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/hpwdt.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/i6300esb.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-05-02T09:29:38.544 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_wdt.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ib700wdt.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ibmasr.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it8712f_wdt.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it87_wdt.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/machzwd.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/nv_tco.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_pci.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_usb.ko 2022-05-02T09:29:38.545 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sch311x_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/softdog.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sp5100_tco.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/via_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83877f_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83977f_wdt.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/wdt_pci.ko 2022-05-02T09:29:38.546 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/xen_wdt.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-acpi-processor.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-evtchn.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntalloc.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntdev.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-privcmd.ko 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs 2022-05-02T09:29:38.547 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs/xenfs.ko 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p/9p.ko 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs/affs.ko 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs/befs.ko 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/binfmt_misc.ko 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs 2022-05-02T09:29:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs/btrfs.ko 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles/cachefiles.ko 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph/ceph.ko 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs/cifs.ko 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda/coda.ko 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs 2022-05-02T09:29:38.549 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs/cramfs.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm/dlm.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs/ecryptfs.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs/f2fs.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/fat.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/msdos.ko 2022-05-02T09:29:38.550 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/vfat.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache/fscache.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/cuse.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/fuse.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2/gfs2.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs/hfs.ko 2022-05-02T09:29:38.551 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus/hfsplus.ko 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs/isofs.ko 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs/jfs.ko 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd/lockd.ko 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix/minix.ko 2022-05-02T09:29:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs/netfs.ko 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-05-02T09:29:38.553 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfs.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv3.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv4.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/grace.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/nfs_acl.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd/nfsd.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2/nilfs2.ko 2022-05-02T09:29:38.554 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-celtic.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-centeuro.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-croatian.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-cyrillic.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-gaelic.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-greek.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-iceland.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-inuit.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-roman.ko 2022-05-02T09:29:38.555 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-romanian.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-turkish.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1250.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1251.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1255.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp737.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp775.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp850.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp852.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp855.ko 2022-05-02T09:29:38.556 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp857.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp860.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp861.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp862.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp863.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp864.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp865.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp866.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp869.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp874.ko 2022-05-02T09:29:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp932.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp936.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp949.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp950.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_euc-jp.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-1.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-13.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-14.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-15.ko 2022-05-02T09:29:38.558 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-2.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-3.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-4.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-5.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-6.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-7.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-9.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-r.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-ru.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-u.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_utf8.ko 2022-05-02T09:29:38.559 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-05-02T09:29:38.560 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs/overlay.ko 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore/ramoops.ko 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs/reiserfs.ko 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs/romfs.ko 2022-05-02T09:29:38.561 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_arc4.ko 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_md4.ko 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs/squashfs.ko 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv/sysv.ko 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf/udf.ko 2022-05-02T09:29:38.562 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs/ufs.ko 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs/xfs.ko 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu/rcutorture.ko 2022-05-02T09:29:38.563 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/torture.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/asn1_encoder.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc-itu-t.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc8.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libarc4.ko 2022-05-02T09:29:38.564 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libdes.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/libcrc32c.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lru_cache.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4_compress.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4hc_compress.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math/cordic.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6/raid6_pq.ko 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon 2022-05-02T09:29:38.565 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon/reed_solomon.ko 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_bm.ko 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_fsm.ko 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_kmp.ko 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd/zstd_compress.ko 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm 2022-05-02T09:29:38.566 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm/hwpoison-inject.ko 2022-05-02T09:29:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net 2022-05-02T09:29:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan 2022-05-02T09:29:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/6lowpan.ko 2022-05-02T09:29:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_dest.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_fragment.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_hop.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_ipv6.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_mobility.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_routing.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_udp.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/garp.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/mrp.ko 2022-05-02T09:29:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/p8022.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/psnap.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/stp.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q/8021q.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_fd.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_rdma.ko 2022-05-02T09:29:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_virtio.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv/batman-adv.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/br_netfilter.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/bridge.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_among.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arp.ko 2022-05-02T09:29:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_limit.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_log.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-05-02T09:29:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_snat.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_stp.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtables.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-05-02T09:29:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph/libceph.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/failover.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/pktgen.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_diag.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv4.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv6.ko 2022-05-02T09:29:38.573 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver/dns_resolver.ko 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/dsa_core.ko 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_brcm.ko 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_dsa.ko 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_trailer.ko 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan 2022-05-02T09:29:38.574 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154_socket.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ah4.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/esp4.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/fou.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/gre.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/inet_diag.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_gre.ko 2022-05-02T09:29:38.575 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_tunnel.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_vti.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipcomp.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipip.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arp_tables.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-05-02T09:29:38.576 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_security.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-05-02T09:29:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_bic.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_dctcp.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_diag.ko 2022-05-02T09:29:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_highspeed.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_htcp.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_hybla.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_illinois.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_lp.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_scalable.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_vegas.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_veno.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_westwood.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_yeah.ko 2022-05-02T09:29:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tunnel4.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_diag.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_tunnel.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/xfrm4_tunnel.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ah6.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/esp6.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/fou6.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_tunnel.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_vti.ko 2022-05-02T09:29:38.580 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ipcomp6.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-05-02T09:29:38.581 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-05-02T09:29:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/sit.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/tunnel6.ko 2022-05-02T09:29:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/xfrm6_tunnel.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key/af_key.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_core.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_debugfs.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_eth.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip6.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_netlink.ko 2022-05-02T09:29:38.584 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ppp.ko 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc/llc.ko 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154/mac802154.ko 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls/mpls_gso.ko 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set.ko 2022-05-02T09:29:38.585 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-05-02T09:29:38.586 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-05-02T09:29:38.587 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-05-02T09:29:38.588 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conncount.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_h323.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_irc.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sane.ko 2022-05-02T09:29:38.589 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sip.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_dup_netdev.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table_inet.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_log_syslog.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_amanda.ko 2022-05-02T09:29:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_ftp.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_irc.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_sip.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_tftp.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_synproxy_core.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_tables.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_acct.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_log.ko 2022-05-02T09:29:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_osf.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_queue.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_chain_nat.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_compat.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_ct.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_dup_netdev.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fib.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fwd_netdev.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_hash.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_limit.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_log.ko 2022-05-02T09:29:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_masq.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_nat.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_numgen.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_objref.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_queue.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_quota.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_redir.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject_inet.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_socket.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_tunnel.ko 2022-05-02T09:29:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_AUDIT.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CHECKSUM.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CLASSIFY.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CT.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_DSCP.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HL.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HMARK.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_IDLETIMER.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LED.ko 2022-05-02T09:29:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LOG.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_MASQUERADE.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NETMAP.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFLOG.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFQUEUE.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_RATEEST.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_REDIRECT.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_SECMARK.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPMSS.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-05-02T09:29:38.595 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TEE.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TPROXY.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TRACE.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_addrtype.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_bpf.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cgroup.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cluster.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_comment.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connbytes.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlabel.ko 2022-05-02T09:29:38.596 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlimit.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connmark.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_conntrack.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cpu.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dccp.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_devgroup.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dscp.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ecn.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_esp.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hashlimit.ko 2022-05-02T09:29:38.597 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_helper.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hl.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipcomp.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_iprange.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipvs.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_l2tp.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_length.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_limit.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mac.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mark.ko 2022-05-02T09:29:38.598 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_multiport.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nat.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nfacct.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_osf.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_owner.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_physdev.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_pkttype.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_policy.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_quota.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_rateest.ko 2022-05-02T09:29:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_realm.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_recent.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_sctp.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_set.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_socket.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_state.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_statistic.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_string.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_tcpmss.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_time.ko 2022-05-02T09:29:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_u32.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink/netlink_diag.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh/nsh.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/openvswitch.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-geneve.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-gre.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-vxlan.ko 2022-05-02T09:29:38.601 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet/af_packet_diag.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_rdma.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_tcp.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_csum.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_gact.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_ipt.ko 2022-05-02T09:29:38.602 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_mirred.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_nat.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_pedit.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_police.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_simple.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_skbedit.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_vlan.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_basic.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_bpf.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_flow.ko 2022-05-02T09:29:38.603 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_fw.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_route.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp6.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_tcindex.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_u32.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_cmp.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_ipset.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_meta.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_nbyte.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_text.ko 2022-05-02T09:29:38.604 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_u32.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_cbq.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_choke.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_codel.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_drr.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_dsmark.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_fq.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_gred.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hfsc.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hhf.ko 2022-05-02T09:29:38.605 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_htb.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_ingress.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_mqprio.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_multiq.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_netem.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_pie.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_plug.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_prio.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_qfq.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_red.ko 2022-05-02T09:29:38.606 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfb.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfq.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_tbf.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_teql.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp_diag.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-05-02T09:29:38.607 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/sunrpc.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/diag.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/tipc.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix/unix_diag.ko 2022-05-02T09:29:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_diag.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_loopback.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm/xfrm_ipcomp.ko 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys 2022-05-02T09:29:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys/trusted.ko 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib/irqbypass.ko 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias.bin 2022-05-02T09:29:38.610 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.bin 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.modinfo 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep.bin 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.devname 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.order 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.softdep 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols.bin 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/.build-id 2022-05-02T09:29:38.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/.build-id/7c 2022-05-02T09:29:38.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/.build-id/7c/b5ca1425e9c48e922494125ed420c3d674fa67 2022-05-02T09:29:38.612 DEBUG:teuthology.task.kernel:get_image_version: 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.612 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:38.638 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2022-05-02T09:29:38.638 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 -a -r /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 ]; then 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/installkernel 5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-05-02T09:29:38.639 INFO:teuthology.orchestra.run.smithi050.stdout:new-kernel-pkg --remove 5.18.0-rc4-ceph-g5efacacc9806 --rminitrd --initrdfile=/boot/initramfs-5.18.0-rc4-ceph-g5efacacc9806.img 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:postuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/update-bootloader ]; then 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/update-bootloader --remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.640 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2022-05-02T09:29:38.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2022-05-02T09:29:38.717 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2022-05-02T09:29:38.718 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2022-05-02T09:29:38.718 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.02 2022-05-02T09:29:38.718 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 123.el8 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Sun 01 May 2022 12:17:57 PM UTC 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Group : System Environment/Base 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 9265449 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Tue 05 Apr 2022 04:12:58 PM UTC, Key ID 05b555b38483c65d 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2022-05-02T09:29:38.719 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Tue 05 Apr 2022 03:27:44 PM UTC 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : kbuilder.bsys.centos.org 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Relocations : (not relocatable) 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : CentOS BuildSystem 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2022-05-02T09:29:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:29:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2022-05-02T09:29:38.722 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-05-02T09:29:38.723 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:38.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-05-02T09:29:39.163 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2022-05-02T09:29:40.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-05-02T09:29:40.969 DEBUG:teuthology.orchestra.run.smithi073:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/config-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/vmlinux-5.18.0-rc4-ceph-g5efacacc9806.bz2 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel 2022-05-02T09:29:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-05-02T09:29:40.996 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crc32c-intel.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-avx2.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-05-02T09:29:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-05-02T09:29:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm 2022-05-02T09:29:41.024 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-amd.ko 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm-intel.ko 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/arch/x86/kvm/kvm.ko 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ansi_cprng.ko 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/anubis.ko 2022-05-02T09:29:41.025 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/arc4.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_memcpy.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_pq.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_raid6_recov.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_tx.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/async_xor.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/async_tx/raid6test.ko 2022-05-02T09:29:41.026 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authenc.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/authencesn.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blake2b_generic.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_common.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/blowfish_generic.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/camellia_generic.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast5_generic.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast6_generic.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cast_common.ko 2022-05-02T09:29:41.027 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/ccm.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cmac.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crc32_generic.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_engine.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/crypto_user.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/cts.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/des_generic.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/dh_generic.ko 2022-05-02T09:29:41.028 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/echainiv.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/essiv.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/fcrypt.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/khazad.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/lz4hc.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/md4.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/michael_mic.ko 2022-05-02T09:29:41.029 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcbc.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/pcrypt.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/rmd160.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/seed.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/serpent_generic.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tcrypt.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/tea.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_common.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/twofish_generic.ko 2022-05-02T09:29:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/vmac.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/wp512.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xcbc.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xor.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/crypto/xxhash_generic.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_ipmi.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/acpi_pad.ko 2022-05-02T09:29:41.031 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/custom_method.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/ec_sys.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/platform_profile.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbs.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/sbshc.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/acpi/video.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/acard-ahci.ko 2022-05-02T09:29:41.032 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ahci_platform.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/ata_generic.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/libahci_platform.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_acpi.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ali.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_amd.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_artop.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atiixp.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_atp867x.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd640.ko 2022-05-02T09:29:41.033 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cmd64x.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_cypress.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_efar.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt366.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt37x.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x2n.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_hpt3x3.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it8213.ko 2022-05-02T09:29:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_it821x.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_jmicron.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_marvell.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_mpiix.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_netcell.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ninja32.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87410.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_ns87415.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_oldpiix.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_opti.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_optidma.ko 2022-05-02T09:29:41.035 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pcmcia.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc2027x.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_piccolo.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_rdc.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sch.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_serverworks.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sil680.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sis.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_sl82c105.ko 2022-05-02T09:29:41.036 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_triflex.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pata_via.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/pdc_adma.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_inic162x.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_mv.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_nv.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_promise.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_qstor.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sil24.ko 2022-05-02T09:29:41.037 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sis.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_svw.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_sx4.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_uli.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_via.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ata/sata_vsc.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/auxdisplay/ks0108.ko 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base 2022-05-02T09:29:41.038 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/base/regmap/regmap-i2c.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/bcma/bcma.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/aoe/aoe.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/brd.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/drbd/drbd.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/floppy.ko 2022-05-02T09:29:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/loop.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/nbd.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/null_blk/null_blk.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/pktcdvd.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/rbd.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/sx8.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/virtio_blk.ko 2022-05-02T09:29:41.040 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/xen-blkfront.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/block/zram/zram.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hangcheck-timer.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/amd-rng.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/intel-rng.ko 2022-05-02T09:29:41.041 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/via-rng.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/hw_random/virtio-rng.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_si.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-05-02T09:29:41.042 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/lp.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/mwave/mwave.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/ppdev.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tlclk.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm.ko 2022-05-02T09:29:41.043 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_atmel.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_infineon.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_nsc.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/uv_mmtimer.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/char/virtio_console.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-05-02T09:29:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/p4-clockmod.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/powernow-k8.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/cpufreq/speedstep-lib.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/ccp/ccp.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-aes.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/padlock-sha.ko 2022-05-02T09:29:41.045 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dca/dca.ko 2022-05-02T09:29:41.046 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/dw/dw_dmac.ko 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/dma/ioat/ioatdma.ko 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/amd64_edac.ko 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/e752x_edac.ko 2022-05-02T09:29:41.047 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/edac_mce_amd.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3000_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i3200_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5000_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5100_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i5400_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7300_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i7core_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/i82975x_edac.ko 2022-05-02T09:29:41.048 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/ie31200_edac.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/sb_edac.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/edac/x38_edac.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/edd.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/firmware/iscsi_ibft.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-ich.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/gpio/gpio-viperboard.ko 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid 2022-05-02T09:29:41.049 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-appleir.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-aureal.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-axff.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-dr.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elecom.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-elo.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-emsff.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gaff.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gt683r.ko 2022-05-02T09:29:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-gyration.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-kbd.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtek-mouse.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-holtekff.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-hyperv.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-icade.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-keytouch.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-kye.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lcpower.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-led.ko 2022-05-02T09:29:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-lenovo.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-dj.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-multitouch.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-ortek.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-penmount.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-petalynx.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-picolcd.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-pl.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-plantronics.ko 2022-05-02T09:29:41.052 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-primax.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-rmi.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-arvo.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-common.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-isku.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kone.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-konepure.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-05-02T09:29:41.053 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-lua.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-pyra.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-ryos.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat-savu.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-roccat.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-saitek.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-samsung.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sensor-hub.ko 2022-05-02T09:29:41.054 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sjoy.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sony.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-speedlink.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-steelseries.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-sunplus.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-thrustmaster.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tivo.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-tmff.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-topseed.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-twinhan.ko 2022-05-02T09:29:41.055 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-uclogic.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-waltop.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-wiimote.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-xinmo.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zpff.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/hid-zydacron.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/uhid.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hid/wacom.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_balloon.ko 2022-05-02T09:29:41.056 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_utils.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hv/hv_vmbus.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/abituguru3.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/acpi_power_meter.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7414.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ad7418.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adc128d818.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1021.ko 2022-05-02T09:29:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1025.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1026.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1029.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm1031.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adm9240.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ads7828.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7410.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7411.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7462.ko 2022-05-02T09:29:41.058 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7470.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7475.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/adt7x10.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/amc6821.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/applesmc.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asb100.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asc7621.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/asus_atk0110.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/atxp1.ko 2022-05-02T09:29:41.059 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/coretemp.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/dme1737.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds1621.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ds620.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc1403.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/emc6w201.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71805f.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f71882fg.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/f75375s.ko 2022-05-02T09:29:41.060 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fam15h_power.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/fschmd.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g760a.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/g762.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl518sm.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/gl520sm.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/hwmon-vid.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5500_temp.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/i5k_amb.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmaem.ko 2022-05-02T09:29:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ibmpex.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina209.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ina2xx.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/it87.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k10temp.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/k8temp.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lineage-pem.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm63.ko 2022-05-02T09:29:41.062 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm73.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm75.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm77.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm78.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm80.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm83.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm85.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm87.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm90.ko 2022-05-02T09:29:41.063 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm92.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm93.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95234.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95241.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/lm95245.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc2945.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4151.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4215.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4222.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4245.ko 2022-05-02T09:29:41.064 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4260.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/ltc4261.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max16065.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1619.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max1668.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max197.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6639.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6642.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6650.ko 2022-05-02T09:29:41.065 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/max6697.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/mcp3021.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6683.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct6775.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/nct7802.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87360.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pc87427.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pcf8591.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-05-02T09:29:41.066 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max16064.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max34440.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/max8688.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-05-02T09:29:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/powr1220.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5627.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch5636.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sch56xx-common.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht15.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sht21.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/shtc1.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/sis5595.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47b397.ko 2022-05-02T09:29:41.068 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m1.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/smsc47m192.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/thmc50.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp102.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp103.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp401.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/tmp421.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via-cputemp.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/via686a.ko 2022-05-02T09:29:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt1211.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/vt8231.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627ehf.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83627hf.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83781d.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83791d.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83792d.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83793.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83795.ko 2022-05-02T09:29:41.070 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l785ts.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/hwmon/w83l786ng.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-05-02T09:29:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-i801.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-isch.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-05-02T09:29:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-parport.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-via.ko 2022-05-02T09:29:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-dev.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-mux.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-smbus.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/i2c/i2c-stub.ko 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core 2022-05-02T09:29:41.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_cm.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_core.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_umad.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/iw_cm.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_cm.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4 2022-05-02T09:29:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-05-02T09:29:41.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input 2022-05-02T09:29:41.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/fm801-gp.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/gameport.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/lightning.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/gameport/ns558.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/joydev.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/keyboard/gpio_keys.ko 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse 2022-05-02T09:29:41.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/appletouch.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/bcm5974.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/cyapatp.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/elan_i2c.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/sermouse.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/synaptics_usb.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/mouse/vsxxxaa.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/rmi4/rmi_core.ko 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio 2022-05-02T09:29:41.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/altera_ps2.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/arc_ps2.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/serio/serio_raw.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/input/sparse-keymap.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/iommu/amd/iommu_v2.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-blinkm.ko 2022-05-02T09:29:41.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-clevo-mail.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lm3530.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-lp3944.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/leds-ss4200.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-05-02T09:29:41.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/bcache/bcache.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-bio-prison.ko 2022-05-02T09:29:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache-smq.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-cache.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-crypt.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-delay.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-flakey.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-log-userspace.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-multipath.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-queue-length.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-raid.ko 2022-05-02T09:29:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-round-robin.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-service-time.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-switch.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-thin-pool.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/dm-verity.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/faulty.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/linear.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/multipath.ko 2022-05-02T09:29:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid0.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid1.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid10.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/md/raid456.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptbase.ko 2022-05-02T09:29:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptctl.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptfc.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptlan.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptsas.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptscsih.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/message/fusion/mptspi.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_ich.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/lpc_sch.ko 2022-05-02T09:29:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/mfd-core.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/sm501.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/viperboard.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/vx855.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/mfd/wl1273-core.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds9802als.ko 2022-05-02T09:29:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/apds990x.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/bh1770glc.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/cb710/cb710.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/at24.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/eeprom/max6875.ko 2022-05-02T09:29:41.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/enclosure.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/hpilo.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29003.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/isl29020.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-me.ko 2022-05-02T09:29:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei-txe.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/mei/mei.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-gru/gru.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xp.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpc.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-05-02T09:29:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_7xx1.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tifm_core.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/tsl2550.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_balloon.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/bonding/bonding.ko 2022-05-02T09:29:41.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/b53/b53_common.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/bcm-sf2.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6060.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/dummy.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/eql.ko 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet 2022-05-02T09:29:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/8390.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-05-02T09:29:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/agere/et131x.ko 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-05-02T09:29:41.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e 2022-05-02T09:29:41.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-05-02T09:29:41.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-05-02T09:29:41.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic 2022-05-02T09:29:41.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-05-02T09:29:41.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/dnet.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ethoc.ko 2022-05-02T09:29:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/fealnx.ko 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e100.ko 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e 2022-05-02T09:29:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-05-02T09:29:41.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/jme.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/skge.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-05-02T09:29:41.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-05-02T09:29:41.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-05-02T09:29:41.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-05-02T09:29:41.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/atp.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-05-02T09:29:41.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis190.ko 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sis/sis900.ko 2022-05-02T09:29:41.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-05-02T09:29:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/cassini.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/niu.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sungem.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/ti/tlan.ko 2022-05-02T09:29:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/geneve.ko 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv 2022-05-02T09:29:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ieee802154/fakelb.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ifb.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ipvlan/ipvlan.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvlan.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/macvtap.ko 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio 2022-05-02T09:29:41.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/mii.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/net_failover.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/netconsole.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/nlmon.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy 2022-05-02T09:29:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/amd.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm7xxx.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/bcm87xx.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/broadcom.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/cicada.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/davicom.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/dp83640.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/et1011c.ko 2022-05-02T09:29:41.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/icplus.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/lxt.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/marvell.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/micrel.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/national.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/phylink.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/qsemi.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/realtek.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/smsc.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/ste10Xp.ko 2022-05-02T09:29:41.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/phy/vitesse.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/bsd_comp.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_async.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_deflate.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_generic.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_mppe.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/ppp_synctty.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppoe.ko 2022-05-02T09:29:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pppox.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/ppp/pptp.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slhc.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/slip/slip.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/sungem_phy.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tap.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_activebackup.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_broadcast.ko 2022-05-02T09:29:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_random.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/tun.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/veth.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/virtio_net.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan 2022-05-02T09:29:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/vxlan/vxlan.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netback/xen-netback.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/net/xen-netfront.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ntb/ntb.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme-core.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/nvme/host/nvme.ko 2022-05-02T09:29:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport.ko 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_cs.ko 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_pc.ko 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/parport/parport_serial.ko 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie 2022-05-02T09:29:41.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/pcie/aer_inject.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pci/xen-pcifront.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/i82092.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/pd6729.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pcmcia/yenta_socket.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform 2022-05-02T09:29:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acer-wmi.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/acerhdf.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/apple-gmux.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-laptop.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/asus-wmi.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/classmate-laptop.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-05-02T09:29:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hdaps.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp-wmi.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/hp_accel.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/intel_ips.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/msi-wmi.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/mxm-wmi.ko 2022-05-02T09:29:41.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-laptop.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/samsung-q10.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/topstar-laptop.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/toshiba_haps.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi-bmof.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/platform/x86/wmi.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_common.ko 2022-05-02T09:29:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/powercap/intel_rapl_msr.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-gpio.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps-ldisc.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/clients/pps_parport.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/pps/pps_core.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp.ko 2022-05-02T09:29:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ptp/ptp_kvm.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq32k.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-bq4802.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1286.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1307.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1374.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1511.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1553.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1672.ko 2022-05-02T09:29:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds1742.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds2404.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-ds3232.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-em3027.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-fm3130.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl12022.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-isl1208.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m41t80.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t35.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-m48t59.ko 2022-05-02T09:29:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-max6900.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-msm6242.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf2127.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf85063.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8523.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8563.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-pcf8583.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rp5c01.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rs5c372.ko 2022-05-02T09:29:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8025.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-rx8581.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-v3020.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/rtc/rtc-x1205.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-9xxx.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-sas.ko 2022-05-02T09:29:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/3w-xxxx.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/BusLogic.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/a100u2w.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aacraid/aacraid.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/advansys.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-05-02T09:29:41.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/am53c974.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/atp870u.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bfa/bfa.ko 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc 2022-05-02T09:29:41.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ch.ko 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/csiostor/csiostor.ko 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i 2022-05-02T09:29:41.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dc395x.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/dmx3191d.ko 2022-05-02T09:29:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esas2r/esas2r.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/esp_scsi.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/fcoe.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/fnic/fnic.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hpsa.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hptiop.ko 2022-05-02T09:29:41.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/hv_storvsc.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/initio.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ipr.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ips.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/isci/isci.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/iscsi_tcp.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libfc/libfc.ko 2022-05-02T09:29:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libiscsi_tcp.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/libsas/libsas.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/lpfc/lpfc.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-05-02T09:29:41.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvsas/mvsas.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/mvumi.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/pmcraid.ko 2022-05-02T09:29:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla1280.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/raid_class.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_debug.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_fc.ko 2022-05-02T09:29:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_sas.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_spi.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/scsi_transport_srp.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ses.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/st.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/stex.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs 2022-05-02T09:29:41.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/virtio_scsi.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/vmw_pvscsi.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/scsi/wd719x.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/ssb/ssb.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-05-02T09:29:41.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/loopback/tcm_loop.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_file.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_iblock.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_mod.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_pscsi.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/target_core_user.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-05-02T09:29:41.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-05-02T09:29:41.142 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty 2022-05-02T09:29:41.143 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_gsm.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/n_hdlc.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/nozomi.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/arc_uart.ko 2022-05-02T09:29:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/serial/jsm/jsm.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/tty/synclink_gt.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_aec.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_cif.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_pci_generic.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/uio/uio_sercos3.ko 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb 2022-05-02T09:29:41.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-acm.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/cdc-wdm.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usblp.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/class/usbtmc.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/sl811-hcd.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/host/u132-hcd.ko 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image 2022-05-02T09:29:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/mdc800.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/image/microtek.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/adutux.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/appledisplay.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi26.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/emi62.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ezusb.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ftdi-elan.ko 2022-05-02T09:29:41.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/idmouse.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/iowarrior.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/isight_firmware.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/ldusb.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/legousbtower.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/trancevibrator.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usb3503.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usblcd.ko 2022-05-02T09:29:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/usbsevseg.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/uss720.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/misc/yurex.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/phy/phy-generic.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/aircable.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ark3116.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/belkin_sa.ko 2022-05-02T09:29:41.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ch341.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cp210x.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cyberjack.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/cypress_m8.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/digi_acceleport.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/empeg.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ftdi_sio.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/garmin_gps.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_edgeport.ko 2022-05-02T09:29:41.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/io_ti.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipaq.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ipw.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ir-usb.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/keyspan_pda.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kl5kusb105.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/kobil_sct.ko 2022-05-02T09:29:41.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mct_u232.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7720.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/mos7840.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/navman.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/omninet.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/opticon.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/option.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/oti6858.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/pl2303.ko 2022-05-02T09:29:41.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcaux.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/qcserial.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/quatech2.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/safe_serial.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/sierra.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/spcp8x5.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ssu100.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/symbolserial.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-05-02T09:29:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_debug.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/usb_wwan.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/visor.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/whiteheat.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/serial/xsens_mt.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/uas.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-alauda.ko 2022-05-02T09:29:41.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-cypress.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-datafab.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-freecom.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-isd200.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-karma.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-onetouch.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-realtek.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr09.ko 2022-05-02T09:29:41.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-sddr55.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/ums-usbat.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/storage/usb-storage.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-core.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/usbip-host.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-05-02T09:29:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/pci/vfio-pci.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vfio/vfio_virqfd.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_iotlb.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_net.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/vhost/vhost_scsi.ko 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video 2022-05-02T09:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/apple_bl.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/lcd.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/video/backlight/platform_lcd.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_balloon.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_mmio.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci.ko 2022-05-02T09:29:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/virtio/virtio_ring.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds1wm.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2482.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/masters/ds2490.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-05-02T09:29:41.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_smem.ko 2022-05-02T09:29:41.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/slaves/w1_therm.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/w1/wire.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim1535_wdt.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/alim7101_wdt.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/f71808e_wdt.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/hpwdt.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/i6300esb.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/iTCO_wdt.ko 2022-05-02T09:29:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ib700wdt.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ibmasr.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it8712f_wdt.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/it87_wdt.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/machzwd.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/nv_tco.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_pci.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/pcwd_usb.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-05-02T09:29:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sch311x_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/softdog.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/sp5100_tco.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/via_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83877f_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/w83977f_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/wdt_pci.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/watchdog/xen_wdt.ko 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen 2022-05-02T09:29:41.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-acpi-processor.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-evtchn.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntalloc.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-gntdev.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xen-privcmd.ko 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs 2022-05-02T09:29:41.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/drivers/xen/xenfs/xenfs.ko 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/9p/9p.ko 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/affs/affs.ko 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/befs/befs.ko 2022-05-02T09:29:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/binfmt_misc.ko 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/btrfs/btrfs.ko 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cachefiles/cachefiles.ko 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ceph/ceph.ko 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cifs/cifs.ko 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda 2022-05-02T09:29:41.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/coda/coda.ko 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/cramfs/cramfs.ko 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/dlm/dlm.ko 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ecryptfs/ecryptfs.ko 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/f2fs/f2fs.ko 2022-05-02T09:29:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/fat.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/msdos.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fat/vfat.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fscache/fscache.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/cuse.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/fuse/fuse.ko 2022-05-02T09:29:41.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/gfs2/gfs2.ko 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfs/hfs.ko 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/hfsplus/hfsplus.ko 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/isofs/isofs.ko 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs 2022-05-02T09:29:41.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/jfs/jfs.ko 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/lockd/lockd.ko 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/minix/minix.ko 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/netfs/netfs.ko 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs 2022-05-02T09:29:41.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfs.ko 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv3.ko 2022-05-02T09:29:41.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs/nfsv4.ko 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/grace.ko 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfs_common/nfs_acl.ko 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nfsd/nfsd.ko 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nilfs2/nilfs2.ko 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls 2022-05-02T09:29:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-celtic.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-centeuro.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-croatian.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-cyrillic.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-gaelic.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-greek.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-iceland.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-inuit.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-roman.ko 2022-05-02T09:29:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-romanian.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/mac-turkish.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1250.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1251.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp1255.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp737.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp775.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp850.ko 2022-05-02T09:29:41.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp852.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp855.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp857.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp860.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp861.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp862.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp863.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp864.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp865.ko 2022-05-02T09:29:41.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp866.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp869.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp874.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp932.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp936.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp949.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_cp950.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_euc-jp.ko 2022-05-02T09:29:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-1.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-13.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-14.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-15.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-2.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-3.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-4.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-5.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-6.ko 2022-05-02T09:29:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-7.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_iso8859-9.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-r.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-ru.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_koi8-u.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/nls/nls_utf8.ko 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster 2022-05-02T09:29:41.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-05-02T09:29:41.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/overlayfs/overlay.ko 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/pstore/ramoops.ko 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/reiserfs/reiserfs.ko 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/romfs/romfs.ko 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common 2022-05-02T09:29:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_arc4.ko 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/smbfs_common/cifs_md4.ko 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/squashfs/squashfs.ko 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/sysv/sysv.ko 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/udf/udf.ko 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs 2022-05-02T09:29:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/ufs/ufs.ko 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/fs/xfs/xfs.ko 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/rcu/rcutorture.ko 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/torture.ko 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace 2022-05-02T09:29:41.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/asn1_encoder.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc-itu-t.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crc8.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libarc4.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/crypto/libdes.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/libcrc32c.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lru_cache.ko 2022-05-02T09:29:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4_compress.ko 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/lz4/lz4hc_compress.ko 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/math/cordic.ko 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/raid6/raid6_pq.ko 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/reed_solomon/reed_solomon.ko 2022-05-02T09:29:41.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_bm.ko 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_fsm.ko 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/ts_kmp.ko 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/lib/zstd/zstd_compress.ko 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/mm/hwpoison-inject.ko 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan 2022-05-02T09:29:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/6lowpan.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_dest.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_fragment.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_hop.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_ipv6.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_mobility.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_routing.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/6lowpan/nhc_udp.ko 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802 2022-05-02T09:29:41.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/garp.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/mrp.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/p8022.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/psnap.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/802/stp.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/8021q/8021q.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_fd.ko 2022-05-02T09:29:41.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_rdma.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/9p/9pnet_virtio.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/batman-adv/batman-adv.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/br_netfilter.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/bridge.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_among.ko 2022-05-02T09:29:41.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arp.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_limit.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_log.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-05-02T09:29:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_snat.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_stp.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/ebtables.ko 2022-05-02T09:29:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ceph/libceph.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/failover.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/core/pktgen.ko 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp 2022-05-02T09:29:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_diag.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv4.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dccp/dccp_ipv6.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dns_resolver/dns_resolver.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/dsa_core.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_brcm.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_dsa.ko 2022-05-02T09:29:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/dsa/tag_trailer.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ieee802154/ieee802154_socket.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ah4.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/esp4.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/fou.ko 2022-05-02T09:29:41.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/gre.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/inet_diag.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_gre.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_tunnel.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ip_vti.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipcomp.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/ipip.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arp_tables.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-05-02T09:29:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/iptable_security.ko 2022-05-02T09:29:41.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-05-02T09:29:41.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_bic.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_dctcp.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_diag.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_highspeed.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_htcp.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_hybla.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_illinois.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_lp.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_scalable.ko 2022-05-02T09:29:41.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_vegas.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_veno.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_westwood.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tcp_yeah.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/tunnel4.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_diag.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/udp_tunnel.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv4/xfrm4_tunnel.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ah6.ko 2022-05-02T09:29:41.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/esp6.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/fou6.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_tunnel.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ip6_vti.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/ipcomp6.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-05-02T09:29:41.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-05-02T09:29:41.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-05-02T09:29:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/sit.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/tunnel6.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/ipv6/xfrm6_tunnel.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/key/af_key.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_core.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_debugfs.ko 2022-05-02T09:29:41.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_eth.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ip6.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_netlink.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/l2tp/l2tp_ppp.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/llc/llc.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mac802154/mac802154.ko 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls 2022-05-02T09:29:41.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/mpls/mpls_gso.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-05-02T09:29:41.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-05-02T09:29:41.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-05-02T09:29:41.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conncount.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-05-02T09:29:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_h323.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_irc.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sane.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_sip.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-05-02T09:29:41.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_dup_netdev.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_flow_table_inet.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_log_syslog.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_amanda.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_ftp.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_irc.ko 2022-05-02T09:29:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_sip.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_nat_tftp.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_synproxy_core.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nf_tables.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_acct.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_log.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_osf.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nfnetlink_queue.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_chain_nat.ko 2022-05-02T09:29:41.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_compat.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_ct.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_dup_netdev.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fib.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_fwd_netdev.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_hash.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_limit.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_log.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_masq.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_nat.ko 2022-05-02T09:29:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_numgen.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_objref.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_queue.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_quota.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_redir.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_reject_inet.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_socket.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/nft_tunnel.ko 2022-05-02T09:29:41.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_AUDIT.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CHECKSUM.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CLASSIFY.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_CT.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_DSCP.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HL.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_HMARK.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_IDLETIMER.ko 2022-05-02T09:29:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LED.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_LOG.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_MASQUERADE.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NETMAP.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFLOG.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_NFQUEUE.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_RATEEST.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_REDIRECT.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_SECMARK.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPMSS.ko 2022-05-02T09:29:41.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TEE.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TPROXY.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_TRACE.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_addrtype.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_bpf.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cgroup.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cluster.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_comment.ko 2022-05-02T09:29:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connbytes.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlabel.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connlimit.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_connmark.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_conntrack.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_cpu.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dccp.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_devgroup.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_dscp.ko 2022-05-02T09:29:41.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ecn.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_esp.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hashlimit.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_helper.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_hl.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipcomp.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_iprange.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_ipvs.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_l2tp.ko 2022-05-02T09:29:41.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_length.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_limit.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mac.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_mark.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_multiport.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nat.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_nfacct.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_osf.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_owner.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_physdev.ko 2022-05-02T09:29:41.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_pkttype.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_policy.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_quota.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_rateest.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_realm.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_recent.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_sctp.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_set.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_socket.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_state.ko 2022-05-02T09:29:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_statistic.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_string.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_tcpmss.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_time.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netfilter/xt_u32.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/netlink/netlink_diag.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/nsh/nsh.ko 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch 2022-05-02T09:29:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/openvswitch.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-geneve.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-gre.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/openvswitch/vport-vxlan.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/packet/af_packet_diag.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_rdma.ko 2022-05-02T09:29:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/rds/rds_tcp.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_csum.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_gact.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_ipt.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_mirred.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_nat.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_pedit.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_police.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_simple.ko 2022-05-02T09:29:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_skbedit.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/act_vlan.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_basic.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_bpf.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_flow.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_fw.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_route.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_rsvp6.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_tcindex.ko 2022-05-02T09:29:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/cls_u32.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_cmp.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_ipset.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_meta.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_nbyte.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_text.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/em_u32.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_cbq.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_choke.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_codel.ko 2022-05-02T09:29:41.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_drr.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_dsmark.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_fq.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_gred.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hfsc.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_hhf.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_htb.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_ingress.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_mqprio.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_multiq.ko 2022-05-02T09:29:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_netem.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_pie.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_plug.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_prio.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_qfq.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_red.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfb.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_sfq.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_tbf.ko 2022-05-02T09:29:41.226 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sched/sch_teql.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sctp/sctp_diag.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/sunrpc.ko 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma 2022-05-02T09:29:41.227 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/diag.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/tipc/tipc.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/unix/unix_diag.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-05-02T09:29:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock.ko 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_diag.ko 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/vmw_vsock/vsock_loopback.ko 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/net/xfrm/xfrm_ipcomp.ko 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys 2022-05-02T09:29:41.229 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/security/keys/trusted-keys/trusted.ko 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/kernel/virt/lib/irqbypass.ko 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.alias.bin 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.bin 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.builtin.modinfo 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep 2022-05-02T09:29:41.230 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.dep.bin 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.devname 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.order 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.softdep 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/5.18.0-rc4-ceph-g5efacacc9806/modules.symbols.bin 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/.build-id 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/.build-id/7c 2022-05-02T09:29:41.231 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/.build-id/7c/b5ca1425e9c48e922494125ed420c3d674fa67 2022-05-02T09:29:41.232 DEBUG:teuthology.task.kernel:get_image_version: 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.232 DEBUG:teuthology.orchestra.run.smithi073:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-05-02T09:29:41.257 INFO:teuthology.orchestra.run.smithi073.stdout:postinstall scriptlet (using /bin/sh): 2022-05-02T09:29:41.257 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 -a -r /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 ]; then 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:cp /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:cp /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:rm -f /boot/vmlinuz-5.18.0-rc4-ceph-g5efacacc9806 /boot/System.map-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/installkernel 5.18.0-rc4-ceph-g5efacacc9806 /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:rm -f /boot/.vmlinuz-5.18.0-rc4-ceph-g5efacacc9806-rpm /boot/.System.map-5.18.0-rc4-ceph-g5efacacc9806-rpm 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:preuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:41.258 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:new-kernel-pkg --remove 5.18.0-rc4-ceph-g5efacacc9806 --rminitrd --initrdfile=/boot/initramfs-5.18.0-rc4-ceph-g5efacacc9806.img 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-install remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:postuninstall scriptlet (using /bin/sh): 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/update-bootloader ]; then 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/update-bootloader --remove 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2022-05-02T09:29:41.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2022-05-02T09:29:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2022-05-02T09:29:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2022-05-02T09:29:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.02 2022-05-02T09:29:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 123.el8 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Sun 01 May 2022 12:17:57 PM UTC 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Group : System Environment/Base 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 9265449 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Tue 05 Apr 2022 04:12:58 PM UTC, Key ID 05b555b38483c65d 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Tue 05 Apr 2022 03:27:44 PM UTC 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : kbuilder.bsys.centos.org 2022-05-02T09:29:41.332 INFO:teuthology.orchestra.run.smithi073.stdout:Relocations : (not relocatable) 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : CentOS BuildSystem 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2022-05-02T09:29:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:29:41.334 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2022-05-02T09:29:41.335 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-05-02T09:29:41.335 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-05-02T09:29:41.337 INFO:teuthology.orchestra.run.smithi086.stderr:done 2022-05-02T09:29:41.339 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2022-05-02T09:29:41.374 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.bcfycgUnmB 2022-05-02T09:29:41.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bcfycgUnmB 2022-05-02T09:29:41.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.bcfycgUnmB 2022-05-02T09:29:41.514 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2022-05-02T09:29:41.616 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.bcfycgUnmB is 6KB 2022-05-02T09:29:41.664 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.bcfycgUnmB 2022-05-02T09:29:41.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2022-05-02T09:29:41.761 INFO:teuthology.orchestra.run.smithi086.stdout:04f723c038b24b1fbdcd71d6475c282d-0-rescue.conf 2022-05-02T09:29:41.761 INFO:teuthology.orchestra.run.smithi086.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-305.3.1.el8.x86_64.conf 2022-05-02T09:29:41.761 INFO:teuthology.orchestra.run.smithi086.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-383.el8.x86_64.conf 2022-05-02T09:29:41.761 INFO:teuthology.orchestra.run.smithi086.stdout:04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806.conf 2022-05-02T09:29:41.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default 04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:41.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2022-05-02T09:29:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:done 2022-05-02T09:29:43.993 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2022-05-02T09:29:44.021 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.XFccCCXO1o 2022-05-02T09:29:44.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XFccCCXO1o 2022-05-02T09:29:44.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.XFccCCXO1o 2022-05-02T09:29:44.177 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2022-05-02T09:29:44.248 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.XFccCCXO1o is 6KB 2022-05-02T09:29:44.297 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.XFccCCXO1o 2022-05-02T09:29:44.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2022-05-02T09:29:44.378 INFO:teuthology.orchestra.run.smithi050.stdout:04f723c038b24b1fbdcd71d6475c282d-0-rescue.conf 2022-05-02T09:29:44.378 INFO:teuthology.orchestra.run.smithi050.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-305.3.1.el8.x86_64.conf 2022-05-02T09:29:44.378 INFO:teuthology.orchestra.run.smithi050.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-383.el8.x86_64.conf 2022-05-02T09:29:44.378 INFO:teuthology.orchestra.run.smithi050.stdout:04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806.conf 2022-05-02T09:29:44.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:44.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2022-05-02T09:29:45.926 INFO:teuthology.orchestra.run.smithi073.stderr:done 2022-05-02T09:29:45.928 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2022-05-02T09:29:45.955 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.oGIZlY9Z0u 2022-05-02T09:29:45.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oGIZlY9Z0u 2022-05-02T09:29:46.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.oGIZlY9Z0u 2022-05-02T09:29:46.195 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.oGIZlY9Z0u is 6KB 2022-05-02T09:29:46.243 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.oGIZlY9Z0u 2022-05-02T09:29:46.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2022-05-02T09:29:46.330 INFO:teuthology.orchestra.run.smithi073.stdout:04f723c038b24b1fbdcd71d6475c282d-0-rescue.conf 2022-05-02T09:29:46.330 INFO:teuthology.orchestra.run.smithi073.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-305.3.1.el8.x86_64.conf 2022-05-02T09:29:46.330 INFO:teuthology.orchestra.run.smithi073.stdout:04f723c038b24b1fbdcd71d6475c282d-4.18.0-383.el8.x86_64.conf 2022-05-02T09:29:46.331 INFO:teuthology.orchestra.run.smithi073.stdout:04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806.conf 2022-05-02T09:29:46.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 04f723c038b24b1fbdcd71d6475c282d-5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:29:46.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2022-05-02T09:30:11.930 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2022-05-02T09:30:11.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-05-02T09:30:11.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:30:14.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2022-05-02T09:30:14.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-05-02T09:30:14.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:30:16.482 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-05-02T09:30:16.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-02T09:30:16.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:30:30.475 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-05-02T09:30:33.035 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2022-05-02T09:30:34.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2022-05-02T09:31:00.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-05-02T09:31:00.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:31:03.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-05-02T09:31:03.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:31:03.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-05-02T09:31:04.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-02T09:31:04.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:31:07.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2022-05-02T09:31:18.712 DEBUG:teuthology.orchestra.run.smithi050:> true 2022-05-02T09:31:19.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-05-02T09:31:19.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.18.0-rc4-ceph-g5efacacc9806"... 2022-05-02T09:31:19.095 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2022-05-02T09:31:19.150 INFO:teuthology.orchestra.run.smithi050.stdout:5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:19.151 DEBUG:teuthology.task.kernel:current kernel version is 5.18.0-rc4-ceph-g5efacacc9806 vs 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:19.151 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-05-02T09:31:19.151 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-05-02T09:31:20.152 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-05-02T09:31:20.152 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-05-02T09:31:20.317 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2022-05-02T09:31:20.334 DEBUG:teuthology.parallel:result is None 2022-05-02T09:31:33.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-05-02T09:31:33.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:31:33.892 DEBUG:teuthology.orchestra.run.smithi086:> true 2022-05-02T09:31:34.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-05-02T09:31:34.299 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.18.0-rc4-ceph-g5efacacc9806"... 2022-05-02T09:31:34.299 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2022-05-02T09:31:34.355 INFO:teuthology.orchestra.run.smithi086.stdout:5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:34.355 DEBUG:teuthology.task.kernel:current kernel version is 5.18.0-rc4-ceph-g5efacacc9806 vs 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:34.355 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-05-02T09:31:34.356 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-05-02T09:31:35.357 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2022-05-02T09:31:35.357 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-05-02T09:31:35.529 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2022-05-02T09:31:35.549 DEBUG:teuthology.parallel:result is None 2022-05-02T09:31:37.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-02T09:31:37.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:31:38.284 DEBUG:teuthology.orchestra.run.smithi073:> true 2022-05-02T09:31:38.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-02T09:31:38.691 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.18.0-rc4-ceph-g5efacacc9806"... 2022-05-02T09:31:38.691 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2022-05-02T09:31:38.747 INFO:teuthology.orchestra.run.smithi073.stdout:5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:38.748 DEBUG:teuthology.task.kernel:current kernel version is 5.18.0-rc4-ceph-g5efacacc9806 vs 5.18.0-rc4-ceph-g5efacacc9806 2022-05-02T09:31:38.748 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-05-02T09:31:38.748 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-05-02T09:31:39.749 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2022-05-02T09:31:39.749 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-05-02T09:31:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2022-05-02T09:31:39.932 DEBUG:teuthology.parallel:result is None 2022-05-02T09:31:39.933 INFO:teuthology.run_tasks:Running task internal.base... 2022-05-02T09:31:39.946 INFO:teuthology.task.internal:Creating test directory... 2022-05-02T09:31:39.946 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-05-02T09:31:39.954 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-05-02T09:31:39.960 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-05-02T09:31:40.022 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-05-02T09:31:40.036 INFO:teuthology.run_tasks:Running task internal.archive... 2022-05-02T09:31:40.101 INFO:teuthology.task.internal:Creating archive directory... 2022-05-02T09:31:40.101 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-05-02T09:31:40.106 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-05-02T09:31:40.112 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-05-02T09:31:40.188 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-05-02T09:31:40.204 INFO:teuthology.task.internal:Enabling coredump saving... 2022-05-02T09:31:40.204 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-05-02T09:31:40.209 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-05-02T09:31:40.214 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-05-02T09:31:40.313 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.320 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.346 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.348 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.351 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-02T09:31:40.356 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-05-02T09:31:40.367 INFO:teuthology.task.internal:Configuring sudo... 2022-05-02T09:31:40.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-05-02T09:31:40.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-05-02T09:31:40.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-05-02T09:31:40.464 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-05-02T09:31:40.473 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-05-02T09:31:40.474 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-05-02T09:31:40.479 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-05-02T09:31:40.484 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-05-02T09:31:40.541 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:40.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:40.725 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:40.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:40.898 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:31:40.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-05-02T09:31:40.985 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:41.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:41.163 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:41.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:41.340 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:31:41.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-05-02T09:31:41.426 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:41.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-02T09:31:41.608 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:41.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-02T09:31:41.782 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:31:41.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-05-02T09:31:41.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2022-05-02T09:31:41.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2022-05-02T09:31:41.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2022-05-02T09:31:42.015 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-05-02T09:31:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-05-02T09:31:42.022 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-05-02T09:31:42.482 INFO:teuthology.run_tasks:Running task internal.timer... 2022-05-02T09:31:42.495 INFO:teuthology.task.internal:Starting timer... 2022-05-02T09:31:42.496 INFO:teuthology.run_tasks:Running task pcp... 2022-05-02T09:31:42.568 INFO:teuthology.run_tasks:Running task selinux... 2022-05-02T09:31:42.714 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-05-02T09:31:42.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2022-05-02T09:31:42.856 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2022-05-02T09:31:42.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2022-05-02T09:31:43.007 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2022-05-02T09:31:43.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2022-05-02T09:31:43.170 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2022-05-02T09:31:43.175 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-05-02T09:31:43.176 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2022-05-02T09:31:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2022-05-02T09:31:43.243 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2022-05-02T09:31:43.319 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2022-05-02T09:31:43.320 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2022-05-02T09:31:43.389 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2022-05-02T09:31:43.390 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive'} 2022-05-02T09:31:43.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-05-02T09:31:43.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:31:43.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-05-02T09:31:43.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:31:43.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-05-02T09:31:43.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:31:43.664 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-05-02T09:31:43.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2022-05-02T09:31:43.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2022-05-02T09:31:43.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2022-05-02T09:31:43.928 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-05-02T09:31:43.941 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2022-05-02T09:31:43.941 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-05-02T09:31:43.960 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-05-02T09:31:43.962 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi073.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-05-02T09:35:56.437 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2022-05-02T09:35:56.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-05-02T09:35:56.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:35:56.545 DEBUG:teuthology.orchestra.run.smithi050:> true 2022-05-02T09:35:56.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-02T09:35:56.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:35:56.764 DEBUG:teuthology.orchestra.run.smithi073:> true 2022-05-02T09:35:56.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-05-02T09:35:56.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-02T09:35:56.993 DEBUG:teuthology.orchestra.run.smithi086:> true 2022-05-02T09:35:57.117 INFO:teuthology.run_tasks:Running task clock... 2022-05-02T09:35:57.143 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-05-02T09:35:57.143 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-05-02T09:35:57.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-05-02T09:35:57.150 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-05-02T09:35:57.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-05-02T09:35:57.156 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-05-02T09:35:57.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-05-02T09:35:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-05-02T09:35:57.242 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-05-02T09:35:57.248 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-05-02T09:35:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-05-02T09:35:57.283 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-05-02T09:35:57.289 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-05-02T09:35:57.383 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2022-05-02T09:35:57.384 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2022-05-02T09:35:57.391 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2022-05-02T09:35:57.418 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2022-05-02T09:35:57.419 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2022-05-02T09:35:57.424 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2022-05-02T09:35:57.459 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-05-02T09:35:57.460 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-05-02T09:35:57.464 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-05-02T09:35:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-05-02T09:35:57.500 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-05-02T09:35:57.505 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-05-02T09:35:57.599 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2022-05-02T09:35:57.601 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2022-05-02T09:35:57.606 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.608 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.610 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-05-02T09:35:57.611 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2022-05-02T09:35:57.611 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.611 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.611 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.611 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.614 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-05-02T09:35:57.614 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2022-05-02T09:35:57.614 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.615 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.615 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.615 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-02T09:35:57.617 INFO:teuthology.run_tasks:Running task install... 2022-05-02T09:35:57.633 DEBUG:teuthology.task.install:project ceph 2022-05-02T09:35:57.634 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'}} 2022-05-02T09:35:57.634 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'} 2022-05-02T09:35:57.634 INFO:teuthology.task.install:Using flavor: default 2022-05-02T09:35:57.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-05-02T09:35:57.641 INFO:teuthology.task.install:extra packages: ['librados2'] 2022-05-02T09:35:57.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:35:57.762 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:35:57.766 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:57.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2022-05-02T09:35:57.767 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'tag': None, 'wait_for_package': False} 2022-05-02T09:35:57.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:35:57.886 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:35:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2022-05-02T09:35:57.891 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:57.891 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:57.891 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:57.891 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:57.891 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:57.891 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:57.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:35:57.897 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:57.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2022-05-02T09:35:57.898 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'tag': None, 'wait_for_package': False} 2022-05-02T09:35:57.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2022-05-02T09:35:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2022-05-02T09:35:58.017 INFO:teuthology.orchestra.run.smithi086.stdout:CentOSStream 2022-05-02T09:35:58.021 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:58.022 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:58.022 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:58.022 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:58.022 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:58.022 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:58.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:35:58.025 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:58.026 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'tag': None, 'wait_for_package': False} 2022-05-02T09:35:58.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2022-05-02T09:35:58.101 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/ 2022-05-02T09:35:58.101 INFO:teuthology.task.install.rpm:Package version is 15.2.16-0 2022-05-02T09:35:58.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-02T09:35:58.144 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:35:58.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-02T09:35:58.145 INFO:teuthology.orchestra.run.smithi086.stdout:CentOSStream 2022-05-02T09:35:58.148 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:35:58.148 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:58.148 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:58.149 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:58.149 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:58.149 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:58.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:35:58.224 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/ 2022-05-02T09:35:58.224 INFO:teuthology.task.install.rpm:Package version is 15.2.16-0 2022-05-02T09:35:58.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-05-02T09:35:58.238 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:58.238 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:58.238 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:58.238 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:58.238 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:58.238 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-02T09:35:58.255 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-02T09:35:58.256 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:35:58.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-02T09:35:58.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-02T09:35:58.347 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-05-02T09:35:58.347 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:58.348 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:58.348 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:58.348 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:58.348 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:58.349 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-02T09:35:58.356 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/ 2022-05-02T09:35:58.358 INFO:teuthology.task.install.rpm:Package version is 15.2.16-0 2022-05-02T09:35:58.393 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/d46a73d6d0a67a79558054a3a5a72cb561724974/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-02T09:35:58.393 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:35:58.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-02T09:35:58.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-02T09:35:58.472 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-02T09:35:58.479 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-05-02T09:35:58.479 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:35:58.480 INFO:teuthology.packaging:ref: None 2022-05-02T09:35:58.480 INFO:teuthology.packaging:tag: None 2022-05-02T09:35:58.480 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:35:58.480 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:35:58.480 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-02T09:35:58.559 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2022-05-02T09:35:58.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-02T09:35:58.591 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-02T09:35:58.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2022-05-02T09:35:58.678 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2022-05-02T09:35:58.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2022-05-02T09:35:58.722 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-02T09:35:58.808 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2022-05-02T09:35:58.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2022-05-02T09:35:58.929 INFO:teuthology.orchestra.run.smithi050.stdout:55 files removed 2022-05-02T09:35:58.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2022-05-02T09:35:58.996 INFO:teuthology.orchestra.run.smithi073.stdout:55 files removed 2022-05-02T09:35:59.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2022-05-02T09:35:59.127 INFO:teuthology.orchestra.run.smithi086.stdout:55 files removed 2022-05-02T09:35:59.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw 2022-05-02T09:35:59.610 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 898 kB/s | 68 kB 00:00 2022-05-02T09:35:59.676 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 620 kB/s | 68 kB 00:00 2022-05-02T09:35:59.703 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 277 kB/s | 15 kB 00:00 2022-05-02T09:35:59.774 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 888 kB/s | 68 kB 00:00 2022-05-02T09:35:59.787 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 31 kB/s | 1.7 kB 00:00 2022-05-02T09:35:59.788 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 203 kB/s | 15 kB 00:00 2022-05-02T09:35:59.886 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 23 kB/s | 1.7 kB 00:00 2022-05-02T09:35:59.908 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 152 kB/s | 15 kB 00:00 2022-05-02T09:36:00.025 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 19 kB/s | 1.7 kB 00:00 2022-05-02T09:36:00.406 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 36 MB/s | 21 MB 00:00 2022-05-02T09:36:00.711 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - AppStream 32 MB/s | 21 MB 00:00 2022-05-02T09:36:00.755 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - AppStream 25 MB/s | 21 MB 00:00 2022-05-02T09:36:05.340 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Base 40 MB/s | 22 MB 00:00 2022-05-02T09:36:05.954 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - Base 20 MB/s | 22 MB 00:01 2022-05-02T09:36:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Base 13 MB/s | 22 MB 00:01 2022-05-02T09:36:09.013 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 139 kB/s | 18 kB 00:00 2022-05-02T09:36:09.399 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - PowerTools 18 MB/s | 4.5 MB 00:00 2022-05-02T09:36:09.453 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - Extras 149 kB/s | 18 kB 00:00 2022-05-02T09:36:09.838 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-8 - PowerTools 18 MB/s | 4.5 MB 00:00 2022-05-02T09:36:10.045 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Extras 166 kB/s | 18 kB 00:00 2022-05-02T09:36:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - PowerTools 16 MB/s | 4.5 MB 00:00 2022-05-02T09:36:10.599 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2022-05-02T09:36:10.937 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2022-05-02T09:36:11.539 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2022-05-02T09:36:12.055 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:00 2022-05-02T09:36:12.382 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 11 MB 00:01 2022-05-02T09:36:12.615 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 12 MB/s | 11 MB 00:00 2022-05-02T09:36:15.264 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 341 kB/s | 24 kB 00:00 2022-05-02T09:36:15.741 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 417 kB/s | 24 kB 00:00 2022-05-02T09:36:15.741 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 413 kB/s | 24 kB 00:00 2022-05-02T09:36:18.165 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:36:18.168 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:36:18.168 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2022-05-02T09:36:18.168 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:36:18.168 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:15.2.16-0.el8 ceph 9.9 M 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:15.2.16-0.el8 ceph 3.5 M 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:15.2.16-0.el8 ceph 1.9 M 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:15.2.16-0.el8 ceph 5.6 M 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:15.2.16-0.el8 ceph 21 M 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:15.2.16-0.el8 ceph 25 k 2022-05-02T09:36:18.169 INFO:teuthology.orchestra.run.smithi086.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:15.2.16-0.el8 ceph 509 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:15.2.16-0.el8 ceph 381 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-05-02T09:36:18.170 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:15.2.16-0.el8 ceph 3.2 M 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:15.2.16-0.el8 ceph 40 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:15.2.16-0.el8 ceph 77 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:15.2.16-0.el8 ceph 164 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:15.2.16-0.el8 ceph 364 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:15.2.16-0.el8 ceph 349 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:15.2.16-0.el8 ceph 113 k 2022-05-02T09:36:18.171 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:36:18.172 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:36:18.172 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:36:18.172 INFO:teuthology.orchestra.run.smithi086.stdout:Install 22 Packages 2022-05-02T09:36:18.172 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2022-05-02T09:36:18.172 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:36:18.173 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 48 M 2022-05-02T09:36:18.173 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:36:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:(1/24): ceph-base-15.2.16-0.el8.x86_64.rpm 23 MB/s | 5.6 MB 00:00 2022-05-02T09:36:18.439 INFO:teuthology.orchestra.run.smithi086.stdout:(2/24): ceph-selinux-15.2.16-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2022-05-02T09:36:18.498 INFO:teuthology.orchestra.run.smithi086.stdout:(3/24): libcephfs2-15.2.16-0.el8.x86_64.rpm 8.5 MB/s | 509 kB 00:00 2022-05-02T09:36:18.548 INFO:teuthology.orchestra.run.smithi086.stdout:(4/24): libradosstriper1-15.2.16-0.el8.x86_64.r 7.5 MB/s | 381 kB 00:00 2022-05-02T09:36:18.639 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:36:18.641 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:15.2.16-0.el8 ceph 9.9 M 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:15.2.16-0.el8 ceph 3.5 M 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:15.2.16-0.el8 ceph 1.9 M 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2022-05-02T09:36:18.642 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:15.2.16-0.el8 ceph 5.6 M 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:15.2.16-0.el8 ceph 21 M 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:15.2.16-0.el8 ceph 25 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:15.2.16-0.el8 ceph 509 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:15.2.16-0.el8 ceph 381 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-05-02T09:36:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:15.2.16-0.el8 ceph 3.2 M 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:15.2.16-0.el8 ceph 40 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:15.2.16-0.el8 ceph 77 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:15.2.16-0.el8 ceph 164 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:15.2.16-0.el8 ceph 364 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:15.2.16-0.el8 ceph 349 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:15.2.16-0.el8 ceph 113 k 2022-05-02T09:36:18.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:36:18.645 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:36:18.645 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:36:18.645 INFO:teuthology.orchestra.run.smithi073.stdout:Install 22 Packages 2022-05-02T09:36:18.645 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2022-05-02T09:36:18.645 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:36:18.647 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 48 M 2022-05-02T09:36:18.647 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:36:18.816 INFO:teuthology.orchestra.run.smithi086.stdout:(5/24): ceph-radosgw-15.2.16-0.el8.x86_64.rpm 16 MB/s | 9.9 MB 00:00 2022-05-02T09:36:18.817 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:15.2.16-0.el8 ceph 9.9 M 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:15.2.16-0.el8 ceph 3.5 M 2022-05-02T09:36:18.821 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:15.2.16-0.el8 ceph 1.9 M 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:15.2.16-0.el8 ceph 5.6 M 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:15.2.16-0.el8 ceph 21 M 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:15.2.16-0.el8 ceph 25 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:15.2.16-0.el8 ceph 509 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-05-02T09:36:18.822 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:15.2.16-0.el8 ceph 381 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:15.2.16-0.el8 ceph 3.2 M 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:15.2.16-0.el8 ceph 40 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:15.2.16-0.el8 ceph 77 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:15.2.16-0.el8 ceph 164 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:15.2.16-0.el8 ceph 364 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:15.2.16-0.el8 ceph 349 k 2022-05-02T09:36:18.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:15.2.16-0.el8 ceph 113 k 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout:Install 22 Packages 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2022-05-02T09:36:18.824 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:36:18.825 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 48 M 2022-05-02T09:36:18.825 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:36:18.849 INFO:teuthology.orchestra.run.smithi086.stdout:(6/24): python3-ceph-argparse-15.2.16-0.el8.x86 1.2 MB/s | 40 kB 00:00 2022-05-02T09:36:18.907 INFO:teuthology.orchestra.run.smithi086.stdout:(7/24): librgw2-15.2.16-0.el8.x86_64.rpm 9.0 MB/s | 3.2 MB 00:00 2022-05-02T09:36:18.933 INFO:teuthology.orchestra.run.smithi086.stdout:(8/24): python3-ceph-common-15.2.16-0.el8.x86_6 918 kB/s | 77 kB 00:00 2022-05-02T09:36:19.001 INFO:teuthology.orchestra.run.smithi086.stdout:(9/24): python3-cephfs-15.2.16-0.el8.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2022-05-02T09:36:19.001 INFO:teuthology.orchestra.run.smithi086.stdout:(10/24): python3-rados-15.2.16-0.el8.x86_64.rpm 5.3 MB/s | 364 kB 00:00 2022-05-02T09:36:19.034 INFO:teuthology.orchestra.run.smithi086.stdout:(11/24): python3-rbd-15.2.16-0.el8.x86_64.rpm 5.1 MB/s | 349 kB 00:00 2022-05-02T09:36:19.058 INFO:teuthology.orchestra.run.smithi073.stdout:(1/24): ceph-base-15.2.16-0.el8.x86_64.rpm 14 MB/s | 5.6 MB 00:00 2022-05-02T09:36:19.059 INFO:teuthology.orchestra.run.smithi086.stdout:(12/24): python3-rgw-15.2.16-0.el8.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2022-05-02T09:36:19.117 INFO:teuthology.orchestra.run.smithi073.stdout:(2/24): ceph-selinux-15.2.16-0.el8.x86_64.rpm 439 kB/s | 25 kB 00:00 2022-05-02T09:36:19.117 INFO:teuthology.orchestra.run.smithi086.stdout:(13/24): librdkafka-0.11.4-3.el8.x86_64.rpm 4.2 MB/s | 354 kB 00:00 2022-05-02T09:36:19.143 INFO:teuthology.orchestra.run.smithi086.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2022-05-02T09:36:19.168 INFO:teuthology.orchestra.run.smithi086.stdout:(15/24): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-05-02T09:36:19.194 INFO:teuthology.orchestra.run.smithi086.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2022-05-02T09:36:19.208 INFO:teuthology.orchestra.run.smithi073.stdout:(3/24): libcephfs2-15.2.16-0.el8.x86_64.rpm 5.4 MB/s | 509 kB 00:00 2022-05-02T09:36:19.242 INFO:teuthology.orchestra.run.smithi050.stdout:(1/24): ceph-base-15.2.16-0.el8.x86_64.rpm 14 MB/s | 5.6 MB 00:00 2022-05-02T09:36:19.267 INFO:teuthology.orchestra.run.smithi073.stdout:(4/24): libradosstriper1-15.2.16-0.el8.x86_64.r 6.4 MB/s | 381 kB 00:00 2022-05-02T09:36:19.283 INFO:teuthology.orchestra.run.smithi050.stdout:(2/24): ceph-selinux-15.2.16-0.el8.x86_64.rpm 621 kB/s | 25 kB 00:00 2022-05-02T09:36:19.351 INFO:teuthology.orchestra.run.smithi050.stdout:(3/24): libcephfs2-15.2.16-0.el8.x86_64.rpm 7.5 MB/s | 509 kB 00:00 2022-05-02T09:36:19.394 INFO:teuthology.orchestra.run.smithi086.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 516 kB/s | 116 kB 00:00 2022-05-02T09:36:19.419 INFO:teuthology.orchestra.run.smithi086.stdout:(18/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2022-05-02T09:36:19.425 INFO:teuthology.orchestra.run.smithi050.stdout:(4/24): libradosstriper1-15.2.16-0.el8.x86_64.r 5.0 MB/s | 381 kB 00:00 2022-05-02T09:36:19.469 INFO:teuthology.orchestra.run.smithi086.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2022-05-02T09:36:19.542 INFO:teuthology.orchestra.run.smithi073.stdout:(5/24): ceph-radosgw-15.2.16-0.el8.x86_64.rpm 11 MB/s | 9.9 MB 00:00 2022-05-02T09:36:19.559 INFO:teuthology.orchestra.run.smithi050.stdout:(5/24): ceph-radosgw-15.2.16-0.el8.x86_64.rpm 14 MB/s | 9.9 MB 00:00 2022-05-02T09:36:19.567 INFO:teuthology.orchestra.run.smithi073.stdout:(6/24): python3-ceph-argparse-15.2.16-0.el8.x86 1.6 MB/s | 40 kB 00:00 2022-05-02T09:36:19.593 INFO:teuthology.orchestra.run.smithi050.stdout:(6/24): python3-ceph-argparse-15.2.16-0.el8.x86 1.2 MB/s | 40 kB 00:00 2022-05-02T09:36:19.601 INFO:teuthology.orchestra.run.smithi073.stdout:(7/24): python3-ceph-common-15.2.16-0.el8.x86_6 2.3 MB/s | 77 kB 00:00 2022-05-02T09:36:19.635 INFO:teuthology.orchestra.run.smithi050.stdout:(7/24): python3-ceph-common-15.2.16-0.el8.x86_6 1.8 MB/s | 77 kB 00:00 2022-05-02T09:36:19.643 INFO:teuthology.orchestra.run.smithi073.stdout:(8/24): python3-cephfs-15.2.16-0.el8.x86_64.rpm 3.9 MB/s | 164 kB 00:00 2022-05-02T09:36:19.669 INFO:teuthology.orchestra.run.smithi050.stdout:(8/24): python3-cephfs-15.2.16-0.el8.x86_64.rpm 4.8 MB/s | 164 kB 00:00 2022-05-02T09:36:19.695 INFO:teuthology.orchestra.run.smithi086.stdout:(20/24): ceph-common-15.2.16-0.el8.x86_64.rpm 14 MB/s | 21 MB 00:01 2022-05-02T09:36:19.701 INFO:teuthology.orchestra.run.smithi073.stdout:(9/24): python3-rados-15.2.16-0.el8.x86_64.rpm 6.1 MB/s | 364 kB 00:00 2022-05-02T09:36:19.702 INFO:teuthology.orchestra.run.smithi050.stdout:(9/24): python3-rados-15.2.16-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2022-05-02T09:36:19.720 INFO:teuthology.orchestra.run.smithi086.stdout:(21/24): leveldb-1.22-1.el8.x86_64.rpm 556 kB/s | 181 kB 00:00 2022-05-02T09:36:19.744 INFO:teuthology.orchestra.run.smithi050.stdout:(10/24): python3-rbd-15.2.16-0.el8.x86_64.rpm 8.3 MB/s | 349 kB 00:00 2022-05-02T09:36:19.753 INFO:teuthology.orchestra.run.smithi073.stdout:(10/24): python3-rbd-15.2.16-0.el8.x86_64.rpm 6.8 MB/s | 349 kB 00:00 2022-05-02T09:36:19.754 INFO:teuthology.orchestra.run.smithi086.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 264 kB/s | 75 kB 00:00 2022-05-02T09:36:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:(11/24): python3-rgw-15.2.16-0.el8.x86_64.rpm 3.4 MB/s | 113 kB 00:00 2022-05-02T09:36:19.819 INFO:teuthology.orchestra.run.smithi073.stdout:(11/24): librgw2-15.2.16-0.el8.x86_64.rpm 5.8 MB/s | 3.2 MB 00:00 2022-05-02T09:36:19.829 INFO:teuthology.orchestra.run.smithi086.stdout:(23/24): librbd1-15.2.16-0.el8.x86_64.rpm 18 MB/s | 1.9 MB 00:00 2022-05-02T09:36:19.844 INFO:teuthology.orchestra.run.smithi073.stdout:(12/24): python3-rgw-15.2.16-0.el8.x86_64.rpm 1.2 MB/s | 113 kB 00:00 2022-05-02T09:36:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:(12/24): librgw2-15.2.16-0.el8.x86_64.rpm 7.7 MB/s | 3.2 MB 00:00 2022-05-02T09:36:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:(13/24): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2022-05-02T09:36:19.905 INFO:teuthology.orchestra.run.smithi086.stdout:(24/24): librados2-15.2.16-0.el8.x86_64.rpm 17 MB/s | 3.5 MB 00:00 2022-05-02T09:36:19.907 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:36:19.907 INFO:teuthology.orchestra.run.smithi086.stdout:Total 28 MB/s | 48 MB 00:01 2022-05-02T09:36:19.911 INFO:teuthology.orchestra.run.smithi073.stdout:(13/24): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2022-05-02T09:36:19.912 INFO:teuthology.orchestra.run.smithi050.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 1.8 MB/s | 44 kB 00:00 2022-05-02T09:36:19.928 INFO:teuthology.orchestra.run.smithi073.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 2.6 MB/s | 44 kB 00:00 2022-05-02T09:36:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:(15/24): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-05-02T09:36:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2022-05-02T09:36:19.964 INFO:teuthology.orchestra.run.smithi073.stdout:(15/24): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2022-05-02T09:36:19.996 INFO:teuthology.orchestra.run.smithi073.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2022-05-02T09:36:20.055 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:36:20.107 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:36:20.107 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:36:20.263 INFO:teuthology.orchestra.run.smithi050.stdout:(17/24): ceph-common-15.2.16-0.el8.x86_64.rpm 15 MB/s | 21 MB 00:01 2022-05-02T09:36:20.304 INFO:teuthology.orchestra.run.smithi073.stdout:(17/24): ceph-common-15.2.16-0.el8.x86_64.rpm 13 MB/s | 21 MB 00:01 2022-05-02T09:36:20.314 INFO:teuthology.orchestra.run.smithi050.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 310 kB/s | 116 kB 00:00 2022-05-02T09:36:20.363 INFO:teuthology.orchestra.run.smithi050.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2022-05-02T09:36:20.401 INFO:teuthology.orchestra.run.smithi073.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 269 kB/s | 116 kB 00:00 2022-05-02T09:36:20.402 INFO:teuthology.orchestra.run.smithi050.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 705 kB/s | 306 kB 00:00 2022-05-02T09:36:20.422 INFO:teuthology.orchestra.run.smithi073.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 720 kB/s | 306 kB 00:00 2022-05-02T09:36:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2022-05-02T09:36:20.447 INFO:teuthology.orchestra.run.smithi073.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2022-05-02T09:36:20.480 INFO:teuthology.orchestra.run.smithi073.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2022-05-02T09:36:20.531 INFO:teuthology.orchestra.run.smithi050.stdout:(22/24): librbd1-15.2.16-0.el8.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2022-05-02T09:36:20.547 INFO:teuthology.orchestra.run.smithi073.stdout:(22/24): leveldb-1.22-1.el8.x86_64.rpm 747 kB/s | 181 kB 00:00 2022-05-02T09:36:20.556 INFO:teuthology.orchestra.run.smithi050.stdout:(23/24): leveldb-1.22-1.el8.x86_64.rpm 618 kB/s | 181 kB 00:00 2022-05-02T09:36:20.614 INFO:teuthology.orchestra.run.smithi073.stdout:(23/24): librbd1-15.2.16-0.el8.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2022-05-02T09:36:20.622 INFO:teuthology.orchestra.run.smithi050.stdout:(24/24): librados2-15.2.16-0.el8.x86_64.rpm 16 MB/s | 3.5 MB 00:00 2022-05-02T09:36:20.626 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:36:20.626 INFO:teuthology.orchestra.run.smithi050.stdout:Total 27 MB/s | 48 MB 00:01 2022-05-02T09:36:20.706 INFO:teuthology.orchestra.run.smithi073.stdout:(24/24): librados2-15.2.16-0.el8.x86_64.rpm 14 MB/s | 3.5 MB 00:00 2022-05-02T09:36:20.709 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:36:20.709 INFO:teuthology.orchestra.run.smithi073.stdout:Total 23 MB/s | 48 MB 00:02 2022-05-02T09:36:20.779 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:36:20.783 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:36:20.787 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:36:20.836 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:36:20.836 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:36:20.859 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:36:20.911 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:36:20.911 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:36:21.541 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:36:21.545 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:36:21.565 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:36:21.568 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:36:21.822 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:36:22.044 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2022-05-02T09:36:22.308 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2022-05-02T09:36:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:36:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:36:22.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2022-05-02T09:36:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2022-05-02T09:36:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2022-05-02T09:36:23.009 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:23.197 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2022-05-02T09:36:23.283 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:23.419 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:23.673 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:36:23.905 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:23.942 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:23.999 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2022-05-02T09:36:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:24.236 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:24.286 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:36:24.313 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:24.494 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:24.597 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:24.802 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:24.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:36:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/26 2022-05-02T09:36:25.025 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:25.029 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:25.160 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:25.420 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:25.625 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:25.694 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:25.749 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:25.778 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/26 2022-05-02T09:36:25.791 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2022-05-02T09:36:26.093 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/26 2022-05-02T09:36:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:36:26.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:26.397 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:36:26.530 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:26.643 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:26.692 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/26 2022-05-02T09:36:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:15.2.16-0.el8.x86_64 14/26 2022-05-02T09:36:26.901 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2022-05-02T09:36:26.929 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:26.945 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:15.2.16-0.el8.x86_64 15/26 2022-05-02T09:36:27.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:36:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:27.141 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:27.253 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:36:27.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2022-05-02T09:36:27.534 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2022-05-02T09:36:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:15.2.16-0.el8.x86_64 14/26 2022-05-02T09:36:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:36:27.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:15.2.16-0.el8.x86_64 15/26 2022-05-02T09:36:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2022-05-02T09:36:27.860 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:36:27.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:28.011 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2022-05-02T09:36:28.090 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:28.209 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:15.2.16-0.el8.x86_64 20/26 2022-05-02T09:36:28.244 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:15.2.16-0.el8.x86_64 14/26 2022-05-02T09:36:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2022-05-02T09:36:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2022-05-02T09:36:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:15.2.16-0.el8.x86_64 15/26 2022-05-02T09:36:28.731 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2022-05-02T09:36:28.829 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:15.2.16-0.el8.x86_64 20/26 2022-05-02T09:36:29.284 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:15.2.16-0.el8.x86_64 16/26 2022-05-02T09:36:29.532 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2022-05-02T09:36:29.866 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2022-05-02T09:36:30.085 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2022-05-02T09:36:30.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:15.2.16-0.el8.x86_64 20/26 2022-05-02T09:36:33.132 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:33.408 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:34.050 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:34.241 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:34.296 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:34.621 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:34.775 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:34.949 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:35.324 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:36.493 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 21/26 2022-05-02T09:36:36.879 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:37.032 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:15.2.16-0.el8.x86_64 22/26 2022-05-02T09:36:37.253 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:56.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2022-05-02T09:36:56.764 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2022-05-02T09:36:56.764 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2022-05-02T09:36:56.764 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2022-05-02T09:36:56.764 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2022-05-02T09:36:56.764 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2022-05-02T09:36:56.765 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2022-05-02T09:36:56.765 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2022-05-02T09:36:56.766 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2022-05-02T09:36:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:36:57.935 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:36:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:36:58.127 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:36:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:58.127 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2022-05-02T09:36:58.127 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2022-05-02T09:36:58.128 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2022-05-02T09:36:58.128 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2022-05-02T09:36:58.128 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2022-05-02T09:36:58.129 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2022-05-02T09:36:58.129 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2022-05-02T09:36:58.129 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2022-05-02T09:36:58.129 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2022-05-02T09:36:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:36:58.437 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:36:58.437 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2022-05-02T09:36:58.969 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2022-05-02T09:36:58.971 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2022-05-02T09:36:58.971 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2022-05-02T09:36:58.971 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2022-05-02T09:36:58.971 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2022-05-02T09:36:58.971 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:36:59.304 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:36:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:36:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:36:59.623 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:36:59.623 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:15.2.16-0.el8.x86_64 1/26 2022-05-02T09:36:59.624 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:15.2.16-0.el8.x86_64 2/26 2022-05-02T09:36:59.624 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:15.2.16-0.el8.x86_64 3/26 2022-05-02T09:36:59.626 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 8/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:15.2.16-0.el8.x86_64 9/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:15.2.16-0.el8.x86_64 11/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:36:59.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:36:59.628 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2022-05-02T09:36:59.629 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:15.2.16-0.el8.x86_64 25/26 2022-05-02T09:36:59.684 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:36:59.684 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:00.192 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:37:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:15.2.16-0.el8.x86_64 24/26 2022-05-02T09:37:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:15.2.16-0.el8.x86_64 librbd1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.411 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: fmt-6.2.1-1.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: leveldb-1.22-1.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-05-02T09:37:00.412 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.413 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:00.414 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:00.414 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2022-05-02T09:37:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:00.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-test 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:15.2.16-0.el8.x86_64 1/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:15.2.16-0.el8.x86_64 2/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:15.2.16-0.el8.x86_64 3/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:37:00.875 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:37:00.876 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 8/26 2022-05-02T09:37:00.876 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:15.2.16-0.el8.x86_64 9/26 2022-05-02T09:37:00.876 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:37:00.876 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:15.2.16-0.el8.x86_64 11/26 2022-05-02T09:37:00.876 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:37:00.877 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:37:00.877 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/26 2022-05-02T09:37:00.877 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2022-05-02T09:37:00.877 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2022-05-02T09:37:00.877 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2022-05-02T09:37:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:15.2.16-0.el8.x86_64 25/26 2022-05-02T09:37:01.607 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:46 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:01.646 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:01.647 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:01.647 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2022-05-02T09:37:01.647 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:15.2.16-0.el8.x86_64 librbd1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.647 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: fmt-6.2.1-1.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb-1.22-1.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-05-02T09:37:01.648 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.649 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:01.650 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:01.650 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:01.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:15.2.16-0.el8.x86_64 1/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:15.2.16-0.el8.x86_64 2/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:15.2.16-0.el8.x86_64 3/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:15.2.16-0.el8.x86_64 4/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:15.2.16-0.el8.x86_64 5/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:15.2.16-0.el8.x86_64 6/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:15.2.16-0.el8.x86_64 7/26 2022-05-02T09:37:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 8/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:15.2.16-0.el8.x86_64 9/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:15.2.16-0.el8.x86_64 10/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:15.2.16-0.el8.x86_64 11/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:15.2.16-0.el8.x86_64 12/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:15.2.16-0.el8.x86_64 13/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2022-05-02T09:37:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:15.2.16-0.el8.x86_64 23/26 2022-05-02T09:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2022-05-02T09:37:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:15.2.16-0.el8.x86_64 25/26 2022-05-02T09:37:02.546 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:15.2.16-0.el8 ceph 42 M 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2022-05-02T09:37:02.662 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Install 5 Packages 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 43 M 2022-05-02T09:37:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 154 M 2022-05-02T09:37:02.664 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:02.664 INFO:teuthology.orchestra.run.smithi086.stdout:(1/5): oniguruma-6.8.2-2.el8.x86_64.rpm 2.3 MB/s | 187 kB 00:00 2022-05-02T09:37:02.666 INFO:teuthology.orchestra.run.smithi086.stdout:(2/5): jq-1.6-3.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2022-05-02T09:37:02.716 INFO:teuthology.orchestra.run.smithi086.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2022-05-02T09:37:02.742 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2022-05-02T09:37:02.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:02.742 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:15.2.16-0.el8.x86_64 librbd1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.743 INFO:teuthology.orchestra.run.smithi073.stdout: fmt-6.2.1-1.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb-1.22-1.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.744 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:02.745 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:02.812 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:47 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:02.851 INFO:teuthology.orchestra.run.smithi086.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 375 kB/s | 69 kB 00:00 2022-05-02T09:37:03.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2022-05-02T09:37:03.558 INFO:teuthology.orchestra.run.smithi086.stdout:(5/5): ceph-test-15.2.16-0.el8.x86_64.rpm 42 MB/s | 42 MB 00:01 2022-05-02T09:37:03.640 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:03.640 INFO:teuthology.orchestra.run.smithi086.stdout:Total 42 MB/s | 43 MB 00:01 2022-05-02T09:37:03.672 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:03.696 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:03.696 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:03.814 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:03.814 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:15.2.16-0.el8 ceph 42 M 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-05-02T09:37:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:Install 5 Packages 2022-05-02T09:37:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 43 M 2022-05-02T09:37:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 154 M 2022-05-02T09:37:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:(1/5): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2022-05-02T09:37:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:(2/5): jq-1.6-3.el8.x86_64.rpm 2.1 MB/s | 202 kB 00:00 2022-05-02T09:37:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2022-05-02T09:37:04.004 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:49 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:04.049 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:04.053 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 393 kB/s | 69 kB 00:00 2022-05-02T09:37:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:04.809 INFO:teuthology.orchestra.run.smithi050.stdout:(5/5): ceph-test-15.2.16-0.el8.x86_64.rpm 42 MB/s | 42 MB 00:00 2022-05-02T09:37:04.811 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:04.812 INFO:teuthology.orchestra.run.smithi050.stdout:Total 43 MB/s | 43 MB 00:00 2022-05-02T09:37:04.843 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-05-02T09:37:04.924 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:04.950 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:04.950 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:04.978 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:04.978 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:04.978 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2022-05-02T09:37:04.978 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:15.2.16-0.el8 ceph 42 M 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-05-02T09:37:04.979 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout:Install 5 Packages 2022-05-02T09:37:04.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:04.981 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 43 M 2022-05-02T09:37:04.981 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 154 M 2022-05-02T09:37:04.981 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:05.053 INFO:teuthology.orchestra.run.smithi073.stdout:(1/5): jq-1.6-3.el8.x86_64.rpm 2.8 MB/s | 202 kB 00:00 2022-05-02T09:37:05.121 INFO:teuthology.orchestra.run.smithi073.stdout:(2/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2022-05-02T09:37:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-05-02T09:37:05.188 INFO:teuthology.orchestra.run.smithi073.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2022-05-02T09:37:05.308 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:05.310 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:05.350 INFO:teuthology.orchestra.run.smithi073.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 303 kB/s | 69 kB 00:00 2022-05-02T09:37:05.403 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:05.565 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-05-02T09:37:06.087 INFO:teuthology.orchestra.run.smithi073.stdout:(5/5): ceph-test-15.2.16-0.el8.x86_64.rpm 38 MB/s | 42 MB 00:01 2022-05-02T09:37:06.087 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:06.087 INFO:teuthology.orchestra.run.smithi073.stdout:Total 39 MB/s | 43 MB 00:01 2022-05-02T09:37:06.200 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:06.224 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:06.224 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-05-02T09:37:06.541 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:06.581 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:06.584 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:06.687 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-05-02T09:37:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-05-02T09:37:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:09.915 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-05-02T09:37:10.185 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:10.626 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:10.626 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:15.2.16-0.el8.x86_64 1/5 2022-05-02T09:37:10.626 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-05-02T09:37:10.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:10.627 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-05-02T09:37:11.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-05-02T09:37:11.100 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:15.2.16-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:11.101 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:11.289 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-05-02T09:37:11.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph 2022-05-02T09:37:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:15.2.16-0.el8.x86_64 1/5 2022-05-02T09:37:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-05-02T09:37:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-05-02T09:37:12.171 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:57 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:12.549 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:15.2.16-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:12.550 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:12.712 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-05-02T09:37:12.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2022-05-02T09:37:13.042 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:15.2.16-0.el8 ceph 6.3 k 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2022-05-02T09:37:13.067 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:15.2.16-0.el8 ceph 2.0 M 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:15.2.16-0.el8 ceph 1.4 M 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:15.2.16-0.el8 ceph-noarch 192 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:15.2.16-0.el8 ceph 4.4 M 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:15.2.16-0.el8 ceph 17 M 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-05-02T09:37:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-05-02T09:37:13.069 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-05-02T09:37:13.069 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-05-02T09:37:13.071 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-05-02T09:37:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:Install 32 Packages 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 28 M 2022-05-02T09:37:13.074 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 91 M 2022-05-02T09:37:13.074 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:13.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:13.107 INFO:teuthology.orchestra.run.smithi086.stdout:(1/32): ceph-15.2.16-0.el8.x86_64.rpm 127 kB/s | 6.3 kB 00:00 2022-05-02T09:37:13.201 INFO:teuthology.orchestra.run.smithi086.stdout:(2/32): ceph-mgr-15.2.16-0.el8.x86_64.rpm 9.9 MB/s | 1.4 MB 00:00 2022-05-02T09:37:13.281 INFO:teuthology.orchestra.run.smithi086.stdout:(3/32): ceph-mds-15.2.16-0.el8.x86_64.rpm 9.0 MB/s | 2.0 MB 00:00 2022-05-02T09:37:13.323 INFO:teuthology.orchestra.run.smithi086.stdout:(4/32): ceph-mgr-modules-core-15.2.16-0.el8.noa 5.7 MB/s | 192 kB 00:00 2022-05-02T09:37:13.431 INFO:teuthology.orchestra.run.smithi086.stdout:(5/32): ceph-mon-15.2.16-0.el8.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2022-05-02T09:37:13.465 INFO:teuthology.orchestra.run.smithi086.stdout:(6/32): python3-mako-1.0.6-13.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2022-05-02T09:37:13.498 INFO:teuthology.orchestra.run.smithi086.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.1 MB/s | 103 kB 00:00 2022-05-02T09:37:13.507 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:15.2.16-0.el8.x86_64 5/5 2022-05-02T09:37:13.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:15.2.16-0.el8.x86_64 1/5 2022-05-02T09:37:13.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-05-02T09:37:13.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-05-02T09:37:13.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-05-02T09:37:13.523 INFO:teuthology.orchestra.run.smithi086.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 424 kB/s | 39 kB 00:00 2022-05-02T09:37:13.549 INFO:teuthology.orchestra.run.smithi086.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2022-05-02T09:37:13.589 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:58 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:13.592 INFO:teuthology.orchestra.run.smithi086.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 237 kB 00:00 2022-05-02T09:37:13.624 INFO:teuthology.orchestra.run.smithi086.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.4 MB/s | 457 kB 00:00 2022-05-02T09:37:13.658 INFO:teuthology.orchestra.run.smithi086.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 3.2 MB/s | 109 kB 00:00 2022-05-02T09:37:13.701 INFO:teuthology.orchestra.run.smithi086.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 5.0 MB/s | 559 kB 00:00 2022-05-02T09:37:13.808 INFO:teuthology.orchestra.run.smithi086.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 291 kB/s | 44 kB 00:00 2022-05-02T09:37:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:15.2.16-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:13.998 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:14.025 INFO:teuthology.orchestra.run.smithi086.stdout:(15/32): ceph-osd-15.2.16-0.el8.x86_64.rpm 20 MB/s | 17 MB 00:00 2022-05-02T09:37:14.060 INFO:teuthology.orchestra.run.smithi086.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 516 kB/s | 185 kB 00:00 2022-05-02T09:37:14.084 INFO:teuthology.orchestra.run.smithi086.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 627 kB/s | 173 kB 00:00 2022-05-02T09:37:14.110 INFO:teuthology.orchestra.run.smithi086.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2022-05-02T09:37:14.135 INFO:teuthology.orchestra.run.smithi086.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2022-05-02T09:37:14.160 INFO:teuthology.orchestra.run.smithi086.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 968 kB/s | 49 kB 00:00 2022-05-02T09:37:14.186 INFO:teuthology.orchestra.run.smithi086.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-05-02T09:37:14.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2022-05-02T09:37:14.236 INFO:teuthology.orchestra.run.smithi086.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2022-05-02T09:37:14.261 INFO:teuthology.orchestra.run.smithi086.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2022-05-02T09:37:14.286 INFO:teuthology.orchestra.run.smithi086.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2022-05-02T09:37:14.311 INFO:teuthology.orchestra.run.smithi086.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 249 kB/s | 19 kB 00:00 2022-05-02T09:37:14.337 INFO:teuthology.orchestra.run.smithi086.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2022-05-02T09:37:14.362 INFO:teuthology.orchestra.run.smithi086.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 389 kB/s | 29 kB 00:00 2022-05-02T09:37:14.387 INFO:teuthology.orchestra.run.smithi086.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2022-05-02T09:37:14.413 INFO:teuthology.orchestra.run.smithi086.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2022-05-02T09:37:14.438 INFO:teuthology.orchestra.run.smithi086.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.2 MB/s | 251 kB 00:00 2022-05-02T09:37:14.463 INFO:teuthology.orchestra.run.smithi086.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2022-05-02T09:37:14.488 INFO:teuthology.orchestra.run.smithi086.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2022-05-02T09:37:14.495 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:14.495 INFO:teuthology.orchestra.run.smithi086.stdout:Total 20 MB/s | 28 MB 00:01 2022-05-02T09:37:14.540 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:14.543 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:15.2.16-0.el8 ceph 6.3 k 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:15.2.16-0.el8 ceph 2.0 M 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:15.2.16-0.el8 ceph 1.4 M 2022-05-02T09:37:14.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:15.2.16-0.el8 ceph-noarch 192 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:15.2.16-0.el8 ceph 4.4 M 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:15.2.16-0.el8 ceph 17 M 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-05-02T09:37:14.545 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-05-02T09:37:14.546 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:14.547 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:14.548 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:14.548 INFO:teuthology.orchestra.run.smithi050.stdout:Install 32 Packages 2022-05-02T09:37:14.548 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:14.549 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 28 M 2022-05-02T09:37:14.550 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 91 M 2022-05-02T09:37:14.550 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:14.620 INFO:teuthology.orchestra.run.smithi050.stdout:(1/32): ceph-15.2.16-0.el8.x86_64.rpm 94 kB/s | 6.3 kB 00:00 2022-05-02T09:37:14.696 INFO:teuthology.orchestra.run.smithi050.stdout:(2/32): ceph-mgr-15.2.16-0.el8.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2022-05-02T09:37:14.746 INFO:teuthology.orchestra.run.smithi050.stdout:(3/32): ceph-mds-15.2.16-0.el8.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2022-05-02T09:37:14.775 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:14.779 INFO:teuthology.orchestra.run.smithi050.stdout:(4/32): ceph-mgr-modules-core-15.2.16-0.el8.noa 5.7 MB/s | 192 kB 00:00 2022-05-02T09:37:14.821 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:14.821 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:14.838 INFO:teuthology.orchestra.run.smithi050.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-05-02T09:37:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 2.4 MB/s | 39 kB 00:00 2022-05-02T09:37:14.889 INFO:teuthology.orchestra.run.smithi050.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.0 MB/s | 103 kB 00:00 2022-05-02T09:37:14.906 INFO:teuthology.orchestra.run.smithi050.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 3.3 MB/s | 54 kB 00:00 2022-05-02T09:37:14.949 INFO:teuthology.orchestra.run.smithi050.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 11 MB/s | 457 kB 00:00 2022-05-02T09:37:14.981 INFO:teuthology.orchestra.run.smithi050.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 237 kB 00:00 2022-05-02T09:37:15.048 INFO:teuthology.orchestra.run.smithi050.stdout:(11/32): ceph-mon-15.2.16-0.el8.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2022-05-02T09:37:15.069 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:00 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:15.090 INFO:teuthology.orchestra.run.smithi050.stdout:(12/32): python3-cryptography-3.2.1-5.el8.x86_6 5.0 MB/s | 559 kB 00:00 2022-05-02T09:37:15.124 INFO:teuthology.orchestra.run.smithi050.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.4 MB/s | 109 kB 00:00 2022-05-02T09:37:15.227 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:15.230 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:15.364 INFO:teuthology.orchestra.run.smithi050.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 160 kB/s | 44 kB 00:00 2022-05-02T09:37:15.583 INFO:teuthology.orchestra.run.smithi050.stdout:(15/32): ceph-osd-15.2.16-0.el8.x86_64.rpm 19 MB/s | 17 MB 00:00 2022-05-02T09:37:15.608 INFO:teuthology.orchestra.run.smithi050.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 383 kB/s | 185 kB 00:00 2022-05-02T09:37:15.641 INFO:teuthology.orchestra.run.smithi050.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 623 kB/s | 173 kB 00:00 2022-05-02T09:37:15.666 INFO:teuthology.orchestra.run.smithi050.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2022-05-02T09:37:15.692 INFO:teuthology.orchestra.run.smithi050.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 352 kB/s | 18 kB 00:00 2022-05-02T09:37:15.717 INFO:teuthology.orchestra.run.smithi050.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 967 kB/s | 49 kB 00:00 2022-05-02T09:37:15.742 INFO:teuthology.orchestra.run.smithi050.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-05-02T09:37:15.793 INFO:teuthology.orchestra.run.smithi050.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2022-05-02T09:37:15.818 INFO:teuthology.orchestra.run.smithi050.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2022-05-02T09:37:15.843 INFO:teuthology.orchestra.run.smithi050.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2022-05-02T09:37:15.869 INFO:teuthology.orchestra.run.smithi050.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 248 kB/s | 19 kB 00:00 2022-05-02T09:37:15.894 INFO:teuthology.orchestra.run.smithi050.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 318 kB/s | 24 kB 00:00 2022-05-02T09:37:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2022-05-02T09:37:15.949 INFO:teuthology.orchestra.run.smithi050.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2022-05-02T09:37:15.961 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:15.964 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2022-05-02T09:37:15.964 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:15.964 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:15.2.16-0.el8 ceph 6.3 k 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:15.2.16-0.el8 ceph 2.0 M 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:15.2.16-0.el8 ceph 1.4 M 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:15.2.16-0.el8 ceph-noarch 192 k 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:15.2.16-0.el8 ceph 4.4 M 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:15.2.16-0.el8 ceph 17 M 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-05-02T09:37:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-05-02T09:37:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-05-02T09:37:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-05-02T09:37:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-05-02T09:37:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-05-02T09:37:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-05-02T09:37:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-05-02T09:37:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-05-02T09:37:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-05-02T09:37:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:15.969 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:15.970 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:15.970 INFO:teuthology.orchestra.run.smithi073.stdout:Install 32 Packages 2022-05-02T09:37:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:15.971 INFO:teuthology.orchestra.run.smithi050.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2022-05-02T09:37:15.971 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 28 M 2022-05-02T09:37:15.971 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 91 M 2022-05-02T09:37:15.971 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:15.995 INFO:teuthology.orchestra.run.smithi050.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.3 MB/s | 251 kB 00:00 2022-05-02T09:37:16.020 INFO:teuthology.orchestra.run.smithi050.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2022-05-02T09:37:16.045 INFO:teuthology.orchestra.run.smithi050.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2022-05-02T09:37:16.050 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:16.051 INFO:teuthology.orchestra.run.smithi050.stdout:Total 19 MB/s | 28 MB 00:01 2022-05-02T09:37:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:(1/32): ceph-15.2.16-0.el8.x86_64.rpm 69 kB/s | 6.3 kB 00:00 2022-05-02T09:37:16.141 INFO:teuthology.orchestra.run.smithi073.stdout:(2/32): ceph-mgr-15.2.16-0.el8.x86_64.rpm 8.6 MB/s | 1.4 MB 00:00 2022-05-02T09:37:16.216 INFO:teuthology.orchestra.run.smithi073.stdout:(3/32): ceph-mds-15.2.16-0.el8.x86_64.rpm 8.3 MB/s | 2.0 MB 00:00 2022-05-02T09:37:16.258 INFO:teuthology.orchestra.run.smithi073.stdout:(4/32): ceph-mgr-modules-core-15.2.16-0.el8.noa 4.5 MB/s | 192 kB 00:00 2022-05-02T09:37:16.326 INFO:teuthology.orchestra.run.smithi073.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-05-02T09:37:16.340 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:16.376 INFO:teuthology.orchestra.run.smithi073.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 782 kB/s | 39 kB 00:00 2022-05-02T09:37:16.389 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:16.389 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:16.451 INFO:teuthology.orchestra.run.smithi073.stdout:(7/32): ceph-mon-15.2.16-0.el8.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2022-05-02T09:37:16.483 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:16.484 INFO:teuthology.orchestra.run.smithi073.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 955 kB/s | 103 kB 00:00 2022-05-02T09:37:16.521 INFO:teuthology.orchestra.run.smithi073.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 811 kB/s | 54 kB 00:00 2022-05-02T09:37:16.560 INFO:teuthology.orchestra.run.smithi073.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 6.0 MB/s | 457 kB 00:00 2022-05-02T09:37:16.594 INFO:teuthology.orchestra.run.smithi073.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 237 kB 00:00 2022-05-02T09:37:16.644 INFO:teuthology.orchestra.run.smithi073.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.2 MB/s | 109 kB 00:00 2022-05-02T09:37:16.694 INFO:teuthology.orchestra.run.smithi073.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 5.5 MB/s | 559 kB 00:00 2022-05-02T09:37:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-05-02T09:37:16.795 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:16.839 INFO:teuthology.orchestra.run.smithi073.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 275 kB/s | 44 kB 00:00 2022-05-02T09:37:16.839 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:16.954 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-05-02T09:37:17.045 INFO:teuthology.orchestra.run.smithi073.stdout:(15/32): ceph-osd-15.2.16-0.el8.x86_64.rpm 19 MB/s | 17 MB 00:00 2022-05-02T09:37:17.078 INFO:teuthology.orchestra.run.smithi073.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 482 kB/s | 185 kB 00:00 2022-05-02T09:37:17.137 INFO:teuthology.orchestra.run.smithi073.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 517 kB/s | 173 kB 00:00 2022-05-02T09:37:17.162 INFO:teuthology.orchestra.run.smithi073.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2022-05-02T09:37:17.187 INFO:teuthology.orchestra.run.smithi073.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 352 kB/s | 18 kB 00:00 2022-05-02T09:37:17.214 INFO:teuthology.orchestra.run.smithi073.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 969 kB/s | 49 kB 00:00 2022-05-02T09:37:17.263 INFO:teuthology.orchestra.run.smithi073.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 778 kB/s | 59 kB 00:00 2022-05-02T09:37:17.276 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-05-02T09:37:17.297 INFO:teuthology.orchestra.run.smithi073.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.5 MB/s | 384 kB 00:00 2022-05-02T09:37:17.322 INFO:teuthology.orchestra.run.smithi073.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2022-05-02T09:37:17.356 INFO:teuthology.orchestra.run.smithi073.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2022-05-02T09:37:17.381 INFO:teuthology.orchestra.run.smithi073.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 224 kB/s | 19 kB 00:00 2022-05-02T09:37:17.406 INFO:teuthology.orchestra.run.smithi073.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 286 kB/s | 24 kB 00:00 2022-05-02T09:37:17.440 INFO:teuthology.orchestra.run.smithi073.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 389 kB/s | 29 kB 00:00 2022-05-02T09:37:17.474 INFO:teuthology.orchestra.run.smithi073.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.5 MB/s | 241 kB 00:00 2022-05-02T09:37:17.499 INFO:teuthology.orchestra.run.smithi073.stdout:(29/32): python3-trustme-0.6.0-4.el8.noarch.rpm 299 kB/s | 27 kB 00:00 2022-05-02T09:37:17.544 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-05-02T09:37:17.566 INFO:teuthology.orchestra.run.smithi073.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2022-05-02T09:37:17.599 INFO:teuthology.orchestra.run.smithi073.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2022-05-02T09:37:17.641 INFO:teuthology.orchestra.run.smithi073.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 511 kB/s | 85 kB 00:00 2022-05-02T09:37:17.645 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:17.646 INFO:teuthology.orchestra.run.smithi073.stdout:Total 17 MB/s | 28 MB 00:01 2022-05-02T09:37:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-05-02T09:37:17.934 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:17.935 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-05-02T09:37:17.977 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:17.987 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:18.045 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:18.131 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-05-02T09:37:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-05-02T09:37:18.309 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-05-02T09:37:18.364 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:18.368 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-05-02T09:37:18.545 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-05-02T09:37:18.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-05-02T09:37:18.887 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-05-02T09:37:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-05-02T09:37:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-05-02T09:37:19.156 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-05-02T09:37:19.341 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-05-02T09:37:19.351 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-05-02T09:37:19.502 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-05-02T09:37:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-05-02T09:37:19.692 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-05-02T09:37:19.897 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-05-02T09:37:20.019 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-05-02T09:37:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-05-02T09:37:20.168 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-05-02T09:37:20.290 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-05-02T09:37:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-05-02T09:37:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-05-02T09:37:20.595 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-05-02T09:37:20.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-05-02T09:37:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-05-02T09:37:20.913 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-05-02T09:37:20.989 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-05-02T09:37:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-05-02T09:37:21.325 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-05-02T09:37:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-05-02T09:37:21.337 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-05-02T09:37:21.526 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-05-02T09:37:21.545 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-05-02T09:37:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-05-02T09:37:21.770 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-05-02T09:37:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-05-02T09:37:21.774 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-05-02T09:37:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-05-02T09:37:22.011 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-05-02T09:37:22.306 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-05-02T09:37:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-05-02T09:37:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-05-02T09:37:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-05-02T09:37:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-05-02T09:37:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-05-02T09:37:22.672 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-05-02T09:37:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-05-02T09:37:22.845 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-05-02T09:37:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-05-02T09:37:23.165 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-05-02T09:37:23.352 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-05-02T09:37:23.358 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-05-02T09:37:23.364 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-05-02T09:37:23.601 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-05-02T09:37:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-05-02T09:37:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-05-02T09:37:23.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-05-02T09:37:24.003 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-05-02T09:37:24.125 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 27/32 2022-05-02T09:37:24.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-05-02T09:37:24.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-05-02T09:37:24.314 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:24.483 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 27/32 2022-05-02T09:37:24.850 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:24.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-05-02T09:37:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-05-02T09:37:25.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-05-02T09:37:25.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-05-02T09:37:25.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-05-02T09:37:25.896 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-05-02T09:37:26.441 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-05-02T09:37:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:26.588 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:26.722 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:26.846 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-05-02T09:37:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:27.100 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:27.224 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:27.239 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-05-02T09:37:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:27.346 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:27.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:27.509 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:27.649 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 27/32 2022-05-02T09:37:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:27.733 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:27.733 INFO:teuthology.orchestra.run.smithi086.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-05-02T09:37:27.734 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:27.846 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:28.022 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:28.246 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-05-02T09:37:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:15.2.16-0.el8.x86_64 1/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:15.2.16-0.el8.x86_64 2/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:15.2.16-0.el8.x86_64 3/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:15.2.16-0.el8.x86_64 4/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:15.2.16-0.el8.x86_64 5/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 6/32 2022-05-02T09:37:28.393 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-05-02T09:37:28.394 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-05-02T09:37:28.394 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-05-02T09:37:28.394 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-05-02T09:37:28.394 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-05-02T09:37:28.394 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-05-02T09:37:28.395 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-05-02T09:37:28.395 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-05-02T09:37:28.395 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-05-02T09:37:28.395 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-05-02T09:37:28.395 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-05-02T09:37:28.396 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-05-02T09:37:28.397 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-05-02T09:37:28.397 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-05-02T09:37:28.397 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-05-02T09:37:28.397 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-05-02T09:37:28.397 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:15.2.16-0.el8.x86_64 1/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:15.2.16-0.el8.x86_64 2/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:15.2.16-0.el8.x86_64 3/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:15.2.16-0.el8.x86_64 4/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:15.2.16-0.el8.x86_64 5/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 6/32 2022-05-02T09:37:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-05-02T09:37:28.928 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-05-02T09:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-05-02T09:37:28.930 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-05-02T09:37:28.930 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-05-02T09:37:28.930 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-05-02T09:37:28.930 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-05-02T09:37:28.930 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-05-02T09:37:29.432 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:15.2.16-0.el8.x86_64 28/32 2022-05-02T09:37:29.629 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-05-02T09:37:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.14-14.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-05-02T09:37:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:29.809 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.821 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-05-02T09:37:29.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.14-14.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2022-05-02T09:37:29.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:29.824 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:30.101 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:15.2.16-0.el8.x86_64 29/32 2022-05-02T09:37:30.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-base 2022-05-02T09:37:30.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-base 2022-05-02T09:37:30.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:30.623 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:15.2.16-0.el8.x86_64 30/32 2022-05-02T09:37:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:15.2.16-0.el8.x86_64 31/32 2022-05-02T09:37:30.934 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:15 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:30.993 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:15 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:31.046 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:31.302 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:15.2.16-0.el8.x86_64 32/32 2022-05-02T09:37:31.302 INFO:teuthology.orchestra.run.smithi073.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-05-02T09:37:31.302 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:31.741 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-base-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:31.801 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:31.803 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:31.803 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:31.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:15.2.16-0.el8.x86_64 1/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:15.2.16-0.el8.x86_64 2/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:15.2.16-0.el8.x86_64 3/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:15.2.16-0.el8.x86_64 4/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:15.2.16-0.el8.x86_64 5/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 6/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-05-02T09:37:31.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-05-02T09:37:31.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-05-02T09:37:31.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-05-02T09:37:31.886 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-base-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:31.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-immutable-object-cache 2022-05-02T09:37:31.950 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:31.952 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:31.952 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:32.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-immutable-object-cache 2022-05-02T09:37:32.755 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:17 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:32.925 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:17 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 2022-05-02T09:37:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-05-02T09:37:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-05-02T09:37:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-05-02T09:37:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-05-02T09:37:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-05-02T09:37:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-05-02T09:37:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2022-05-02T09:37:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-05-02T09:37:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-05-02T09:37:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-13.el8.noarch 2022-05-02T09:37:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-05-02T09:37:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-05-02T09:37:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-9.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-05-02T09:37:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:32.981 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:33.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2022-05-02T09:37:33.628 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:33.628 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:15.2.16-0.el8 ceph 203 k 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:37:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:33.630 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 203 k 2022-05-02T09:37:33.630 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 599 k 2022-05-02T09:37:33.630 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:33.685 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-immutable-object-cache-15.2.16-0.el8.x86_6 3.7 MB/s | 203 kB 00:00 2022-05-02T09:37:33.685 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:33.686 INFO:teuthology.orchestra.run.smithi086.stdout:Total 3.6 MB/s | 203 kB 00:00 2022-05-02T09:37:33.686 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:33.700 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:33.700 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:33.759 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:33.764 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:15.2.16-0.el8 ceph 203 k 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:37:33.880 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 203 k 2022-05-02T09:37:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 599 k 2022-05-02T09:37:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:33.896 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:33.926 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-immutable-object-cache-15.2.16-0.el8.x86_6 4.3 MB/s | 203 kB 00:00 2022-05-02T09:37:33.927 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:33.927 INFO:teuthology.orchestra.run.smithi050.stdout:Total 4.2 MB/s | 203 kB 00:00 2022-05-02T09:37:33.927 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:33.943 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:33.943 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:34.006 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:34.009 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:34.084 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:34.117 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:19 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:34.919 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:34.957 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:34.979 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:34.980 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:37:34.980 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:35.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2022-05-02T09:37:35.205 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:35.405 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:35.406 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:35.406 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:35.406 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:35.406 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:35.406 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:35.617 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:35.617 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:35.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr 2022-05-02T09:37:35.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2022-05-02T09:37:35.910 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:20 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:36.472 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:21 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:36.747 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:21 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:36.801 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:36.801 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2022-05-02T09:37:36.801 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:15.2.16-0.el8 ceph 203 k 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:37:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:36.803 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 203 k 2022-05-02T09:37:36.803 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 599 k 2022-05-02T09:37:36.803 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:36.855 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-15.2.16-0.el8.x86_6 3.8 MB/s | 203 kB 00:00 2022-05-02T09:37:36.856 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:36.856 INFO:teuthology.orchestra.run.smithi073.stdout:Total 3.7 MB/s | 203 kB 00:00 2022-05-02T09:37:36.856 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:36.871 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:36.871 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:36.930 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:36.934 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:37.275 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:37.276 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-mgr-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:37.335 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:37.336 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:37.336 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:37.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-fuse 2022-05-02T09:37:37.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:37.688 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:37.690 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:37.690 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:37.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2022-05-02T09:37:38.266 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:23 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:38.392 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:38.659 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:23 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:38.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:38.846 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:38.847 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:38.847 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:38.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:38.847 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:39.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2022-05-02T09:37:39.139 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:39.140 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:39.140 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:39.140 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:15.2.16-0.el8 ceph 574 k 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout:Install 2 Packages 2022-05-02T09:37:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:39.142 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 657 k 2022-05-02T09:37:39.142 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 1.8 M 2022-05-02T09:37:39.142 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:39.212 INFO:teuthology.orchestra.run.smithi086.stdout:(1/2): ceph-fuse-15.2.16-0.el8.x86_64.rpm 8.2 MB/s | 574 kB 00:00 2022-05-02T09:37:39.253 INFO:teuthology.orchestra.run.smithi086.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 750 kB/s | 83 kB 00:00 2022-05-02T09:37:39.255 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:39.255 INFO:teuthology.orchestra.run.smithi086.stdout:Total 5.7 MB/s | 657 kB 00:00 2022-05-02T09:37:39.291 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:39.317 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:39.317 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:39.432 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:39.435 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:39.582 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:15.2.16-0.el8 ceph 574 k 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:39.583 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:39.584 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:39.584 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2022-05-02T09:37:39.584 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:39.584 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 657 k 2022-05-02T09:37:39.585 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.8 M 2022-05-02T09:37:39.585 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:39.646 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): ceph-fuse-15.2.16-0.el8.x86_64.rpm 9.2 MB/s | 574 kB 00:00 2022-05-02T09:37:39.663 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2022-05-02T09:37:39.664 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:39.664 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.0 MB/s | 657 kB 00:00 2022-05-02T09:37:39.701 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:39.728 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:39.730 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:39.843 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:39.931 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:24 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-05-02T09:37:40.478 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:40.738 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:40.798 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:40.800 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:37:40.800 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:40.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2022-05-02T09:37:41.257 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:41.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:15.2.16-0.el8.x86_64 1/2 2022-05-02T09:37:41.586 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:41.724 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:26 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-05-02T09:37:42.031 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:42.612 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:42.722 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:42.722 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:42.722 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:15.2.16-0.el8 ceph 574 k 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2022-05-02T09:37:42.724 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:42.724 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 657 k 2022-05-02T09:37:42.724 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.8 M 2022-05-02T09:37:42.724 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:42.815 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:42.815 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:15.2.16-0.el8.x86_64 1/2 2022-05-02T09:37:43.338 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-05-02T09:37:43.338 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:43.338 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:43.338 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:15.2.16-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-05-02T09:37:43.339 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:43.339 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:15.2.16-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:43.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados-devel 2022-05-02T09:37:43.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados-devel 2022-05-02T09:37:43.688 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): ceph-fuse-15.2.16-0.el8.x86_64.rpm 535 kB/s | 574 kB 00:01 2022-05-02T09:37:43.779 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 71 kB/s | 83 kB 00:01 2022-05-02T09:37:43.781 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:43.781 INFO:teuthology.orchestra.run.smithi073.stdout:Total 562 kB/s | 657 kB 00:01 2022-05-02T09:37:43.819 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:43.846 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:43.846 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:43.960 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:44.413 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:29 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-05-02T09:37:44.499 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:29 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:45.274 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:45.275 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:45.275 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:45.275 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:45.275 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:37:45.276 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:45.277 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 140 k 2022-05-02T09:37:45.277 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 478 k 2022-05-02T09:37:45.277 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:45.342 INFO:teuthology.orchestra.run.smithi086.stdout:librados-devel-15.2.16-0.el8.x86_64.rpm 2.1 MB/s | 140 kB 00:00 2022-05-02T09:37:45.342 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:45.342 INFO:teuthology.orchestra.run.smithi086.stdout:Total 2.1 MB/s | 140 kB 00:00 2022-05-02T09:37:45.343 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:45.351 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:45.351 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:45.419 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:45.420 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:45.420 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:37:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:45.422 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 140 k 2022-05-02T09:37:45.423 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 478 k 2022-05-02T09:37:45.423 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:45.423 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:45.451 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:15.2.16-0.el8.x86_64 2/2 2022-05-02T09:37:45.451 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:15.2.16-0.el8.x86_64 1/2 2022-05-02T09:37:45.469 INFO:teuthology.orchestra.run.smithi050.stdout:librados-devel-15.2.16-0.el8.x86_64.rpm 3.0 MB/s | 140 kB 00:00 2022-05-02T09:37:45.469 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:45.469 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.9 MB/s | 140 kB 00:00 2022-05-02T09:37:45.470 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:45.480 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:45.480 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:45.546 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:45.551 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:45.554 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:45.685 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:45.763 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-05-02T09:37:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:45.971 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:15.2.16-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-05-02T09:37:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:45.972 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:46.183 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:46.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2022-05-02T09:37:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:46.699 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:46.700 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:46.700 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:46.700 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:46.700 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:46.700 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:46.762 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:46.762 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:46.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs2 2022-05-02T09:37:46.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2022-05-02T09:37:47.060 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:32 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:47.772 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:32 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:47.839 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:32 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:47.920 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:47.921 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:47.922 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:37:47.922 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:47.922 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 140 k 2022-05-02T09:37:47.922 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 478 k 2022-05-02T09:37:47.923 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:47.984 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-15.2.16-0.el8.x86_64.rpm 2.3 MB/s | 140 kB 00:00 2022-05-02T09:37:47.985 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:47.985 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.2 MB/s | 140 kB 00:00 2022-05-02T09:37:47.985 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:47.993 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:47.993 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:48.057 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:48.060 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:48.188 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:48.570 INFO:teuthology.orchestra.run.smithi086.stdout:Package libcephfs2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:48.629 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:48.631 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:48.631 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:48.720 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:48.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs-devel 2022-05-02T09:37:48.784 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:48.785 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:48.786 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:48.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:49.425 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:49.570 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:34 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:49.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2022-05-02T09:37:49.750 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:34 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:50.460 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:15.2.16-0.el8 ceph 22 k 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:50.462 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:37:50.463 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:37:50.463 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:37:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:50.463 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 22 k 2022-05-02T09:37:50.463 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 78 k 2022-05-02T09:37:50.464 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:37:50.521 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:35 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:50.527 INFO:teuthology.orchestra.run.smithi086.stdout:libcephfs-devel-15.2.16-0.el8.x86_64.rpm 335 kB/s | 22 kB 00:00 2022-05-02T09:37:50.528 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:50.528 INFO:teuthology.orchestra.run.smithi086.stdout:Total 327 kB/s | 22 kB 00:00 2022-05-02T09:37:50.528 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:37:50.534 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:37:50.534 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:37:50.537 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:37:50.540 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:37:50.594 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:37:50.712 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:15.2.16-0.el8 ceph 22 k 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:50.713 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:37:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:37:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:37:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 22 k 2022-05-02T09:37:50.715 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 78 k 2022-05-02T09:37:50.715 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:37:50.755 INFO:teuthology.orchestra.run.smithi050.stdout:libcephfs-devel-15.2.16-0.el8.x86_64.rpm 541 kB/s | 22 kB 00:00 2022-05-02T09:37:50.756 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:50.756 INFO:teuthology.orchestra.run.smithi050.stdout:Total 522 kB/s | 22 kB 00:00 2022-05-02T09:37:50.756 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:37:50.762 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:37:50.762 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:37:50.765 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:37:50.769 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:37:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:50.820 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:37:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:51.141 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:51.304 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:51.320 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:51.380 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:51.381 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:37:51.381 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:51.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2022-05-02T09:37:51.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:51.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:51.752 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:37:51.752 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:51.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:37:51.752 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:51.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2022-05-02T09:37:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:51.898 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:37:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:37:51.898 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:52.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados2 2022-05-02T09:37:52.317 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:37 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:52.754 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:37 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:37 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:53.215 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:37:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:37:53.216 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:15.2.16-0.el8 ceph 22 k 2022-05-02T09:37:53.216 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:37:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:37:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:37:53.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 22 k 2022-05-02T09:37:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 78 k 2022-05-02T09:37:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:37:53.283 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-15.2.16-0.el8.x86_64.rpm 308 kB/s | 22 kB 00:00 2022-05-02T09:37:53.284 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:37:53.284 INFO:teuthology.orchestra.run.smithi073.stdout:Total 302 kB/s | 22 kB 00:00 2022-05-02T09:37:53.285 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:37:53.290 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:37:53.291 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:37:53.293 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:37:53.297 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:37:53.351 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:37:53.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:53.618 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:53.681 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:53.684 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:53.685 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:53.685 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:53.743 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:53.744 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:53.744 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:53.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2022-05-02T09:37:53.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librbd1 2022-05-02T09:37:53.859 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:15.2.16-0.el8.x86_64 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:37:54.321 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:54.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2022-05-02T09:37:54.677 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:39 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:54.688 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:39 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:55.291 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:40 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:55.478 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:55.540 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:55.541 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:55.541 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:55.564 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:55.628 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:55.630 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:55.630 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:55.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rados 2022-05-02T09:37:55.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2022-05-02T09:37:56.097 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:56.157 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:56.160 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:37:56.160 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:56.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2022-05-02T09:37:56.497 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:41 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:56.610 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:41 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:57.107 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:57.312 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rados-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:57.374 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:57.375 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:57.375 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:57.502 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:57.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rgw 2022-05-02T09:37:57.567 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:57.568 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:57.568 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:57.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2022-05-02T09:37:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:57.968 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:37:57.969 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:37:57.970 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:37:58.329 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:43 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:58.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2022-05-02T09:37:58.541 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:43 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:59.135 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rgw-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:59.195 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:37:59.196 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:37:59.197 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:37:59.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-cephfs 2022-05-02T09:37:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:44 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:37:59.453 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:37:59.523 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:37:59.524 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:37:59.524 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:37:59.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2022-05-02T09:38:00.130 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:45 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:00.228 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:00.230 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:38:00.230 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:00.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2022-05-02T09:38:00.508 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:45 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:00.945 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-cephfs-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:01.006 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:01.007 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:38:01.007 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:01.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rbd 2022-05-02T09:38:01.168 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:46 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:01.409 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:01.476 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:01.477 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:38:01.477 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:01.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2022-05-02T09:38:01.937 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:46 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:01.967 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:02.029 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:02.030 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:38:02.030 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:02.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2022-05-02T09:38:02.447 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:47 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:02.736 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rbd-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:02.796 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:02.797 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:38:02.798 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:02.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-fuse 2022-05-02T09:38:02.997 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:47 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:03.362 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:03.427 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:03.428 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:38:03.428 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:03.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2022-05-02T09:38:03.725 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:48 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:03.819 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:03.879 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:03.881 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:38:03.881 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:04.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2022-05-02T09:38:04.414 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:49 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:04.617 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:04.617 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:15.2.16-0.el8 ceph 72 k 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:38:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:04.619 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 72 k 2022-05-02T09:38:04.619 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 184 k 2022-05-02T09:38:04.619 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:38:04.667 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-fuse-15.2.16-0.el8.x86_64.rpm 1.5 MB/s | 72 kB 00:00 2022-05-02T09:38:04.668 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:04.669 INFO:teuthology.orchestra.run.smithi086.stdout:Total 1.4 MB/s | 72 kB 00:00 2022-05-02T09:38:04.669 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:38:04.682 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:38:04.761 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:38:04.762 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:38:04.762 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:38:04.859 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:38:04.997 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:49 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:15.2.16-0.el8 ceph 72 k 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 72 k 2022-05-02T09:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 184 k 2022-05-02T09:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:38:05.403 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-15.2.16-0.el8.x86_64.rpm 1.5 MB/s | 72 kB 00:00 2022-05-02T09:38:05.403 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:05.404 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.4 MB/s | 72 kB 00:00 2022-05-02T09:38:05.404 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:38:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:38:05.801 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:05.864 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:05.865 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:38:05.865 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:05.985 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:06.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2022-05-02T09:38:06.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-mirror 2022-05-02T09:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:06.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:06.751 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:06.751 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:38:06.751 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:06.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:06.752 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:06.818 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:51 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:06.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-mirror 2022-05-02T09:38:07.055 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:52 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:07.687 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:15.2.16-0.el8 ceph 72 k 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:07.688 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 72 k 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 184 k 2022-05-02T09:38:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-15.2.16-0.el8.x86_64.rpm 1.3 MB/s | 72 kB 00:00 2022-05-02T09:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 72 kB 00:00 2022-05-02T09:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:38:07.757 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:38:07.758 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:38:07.827 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:38:07.831 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:52 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:07.927 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:07.927 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:15.2.16-0.el8 ceph 2.7 M 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:38:07.928 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:07.929 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 2.7 M 2022-05-02T09:38:07.929 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 9.8 M 2022-05-02T09:38:07.929 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:38:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:38:08.028 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-mirror-15.2.16-0.el8.x86_64.rpm 27 MB/s | 2.7 MB 00:00 2022-05-02T09:38:08.029 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:08.030 INFO:teuthology.orchestra.run.smithi086.stdout:Total 27 MB/s | 2.7 MB 00:00 2022-05-02T09:38:08.030 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:38:08.046 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:38:08.046 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:38:08.115 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:38:08.118 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:38:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:08.502 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:38:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:08.737 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:08.819 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:15.2.16-0.el8 ceph 2.7 M 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:08.820 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:38:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:08.821 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.7 M 2022-05-02T09:38:08.821 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 9.8 M 2022-05-02T09:38:08.821 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:38:08.922 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-mirror-15.2.16-0.el8.x86_64.rpm 27 MB/s | 2.7 MB 00:00 2022-05-02T09:38:08.923 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:08.923 INFO:teuthology.orchestra.run.smithi050.stdout:Total 26 MB/s | 2.7 MB 00:00 2022-05-02T09:38:08.923 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:38:08.940 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:38:08.940 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:38:09.014 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:38:09.017 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:38:09.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:09.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:09.246 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:38:09.246 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:09.247 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:09.247 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:38:09.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2022-05-02T09:38:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:09.600 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:10.014 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:10.014 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:10.014 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:38:10.014 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:10.015 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:10.015 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:10.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-nbd 2022-05-02T09:38:10.369 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:55 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:10.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:10.904 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:10.904 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:38:10.905 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:10.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:10.905 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:11.090 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:56 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:11.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-nbd 2022-05-02T09:38:11.244 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:11.245 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:11.245 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:11.245 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:11.245 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:38:11.245 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:15.2.16-0.el8 ceph 2.7 M 2022-05-02T09:38:11.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:11.246 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:38:11.246 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:11.246 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:38:11.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:11.247 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.7 M 2022-05-02T09:38:11.247 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 9.8 M 2022-05-02T09:38:11.247 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:38:11.364 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-15.2.16-0.el8.x86_64.rpm 23 MB/s | 2.7 MB 00:00 2022-05-02T09:38:11.365 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:11.365 INFO:teuthology.orchestra.run.smithi073.stdout:Total 23 MB/s | 2.7 MB 00:00 2022-05-02T09:38:11.366 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:38:11.381 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:38:11.381 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:38:11.451 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:38:11.454 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:38:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:38:11.951 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2022-05-02T09:38:11.952 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2022-05-02T09:38:11.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:11.953 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 140 k 2022-05-02T09:38:11.953 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 418 k 2022-05-02T09:38:11.953 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2022-05-02T09:38:12.008 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-nbd-15.2.16-0.el8.x86_64.rpm 2.6 MB/s | 140 kB 00:00 2022-05-02T09:38:12.008 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:12.008 INFO:teuthology.orchestra.run.smithi086.stdout:Total 2.5 MB/s | 140 kB 00:00 2022-05-02T09:38:12.008 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2022-05-02T09:38:12.016 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:57 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:12.020 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2022-05-02T09:38:12.021 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2022-05-02T09:38:12.081 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2022-05-02T09:38:12.084 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2022-05-02T09:38:12.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2022-05-02T09:38:12.933 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:12.971 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2022-05-02T09:38:12.972 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2022-05-02T09:38:12.973 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:12.973 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 140 k 2022-05-02T09:38:12.973 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 418 k 2022-05-02T09:38:12.973 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:38:13.017 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-nbd-15.2.16-0.el8.x86_64.rpm 3.2 MB/s | 140 kB 00:00 2022-05-02T09:38:13.017 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:13.017 INFO:teuthology.orchestra.run.smithi050.stdout:Total 3.1 MB/s | 140 kB 00:00 2022-05-02T09:38:13.018 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:38:13.032 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:38:13.032 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:38:13.060 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:13.095 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:38:13.099 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:38:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:38:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:13.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:13.513 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:38:13.513 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:13.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:13.513 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:13.514 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:13.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2022-05-02T09:38:13.995 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:13.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:13.996 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2022-05-02T09:38:13.996 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:13.996 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:13.996 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:14.007 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:14.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados2 2022-05-02T09:38:14.519 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:59 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:14.557 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:14.557 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:14.557 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:38:14.558 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:14.558 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:14.558 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:14.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2022-05-02T09:38:15.048 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:02:00 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:15.380 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:15.380 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2022-05-02T09:38:15.380 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:15.380 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:15.2.16-0.el8 ceph 140 k 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2022-05-02T09:38:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:15.382 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 140 k 2022-05-02T09:38:15.382 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 418 k 2022-05-02T09:38:15.382 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2022-05-02T09:38:15.434 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-15.2.16-0.el8.x86_64.rpm 2.6 MB/s | 140 kB 00:00 2022-05-02T09:38:15.435 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:38:15.435 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.6 MB/s | 140 kB 00:00 2022-05-02T09:38:15.435 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2022-05-02T09:38:15.449 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2022-05-02T09:38:15.449 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2022-05-02T09:38:15.508 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2022-05-02T09:38:15.512 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2022-05-02T09:38:15.628 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:00 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2022-05-02T09:38:15.843 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:15.902 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2022-05-02T09:38:15.903 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2022-05-02T09:38:15.904 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2022-05-02T09:38:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:16.014 DEBUG:teuthology.parallel:result is None 2022-05-02T09:38:16.357 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:16.533 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:16.596 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:38:16.598 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2022-05-02T09:38:16.598 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:38:16.705 DEBUG:teuthology.parallel:result is None 2022-05-02T09:38:16.883 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:15.2.16-0.el8.x86_64 1/1 2022-05-02T09:38:16.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:16.883 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2022-05-02T09:38:16.883 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:15.2.16-0.el8.x86_64 2022-05-02T09:38:16.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:16.884 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:17.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2022-05-02T09:38:17.996 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:02 ago on Mon 02 May 2022 09:36:15 AM UTC. 2022-05-02T09:38:18.803 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:15.2.16-0.el8.x86_64 is already installed. 2022-05-02T09:38:18.863 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2022-05-02T09:38:18.864 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2022-05-02T09:38:18.864 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2022-05-02T09:38:18.982 DEBUG:teuthology.parallel:result is None 2022-05-02T09:38:18.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:38:19.108 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:38:19.113 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:38:19.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:38:19.113 INFO:teuthology.packaging:ref: None 2022-05-02T09:38:19.113 INFO:teuthology.packaging:tag: None 2022-05-02T09:38:19.114 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:38:19.114 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:38:19.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:38:19.323 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-02T09:38:19.392 INFO:teuthology.orchestra.run.smithi050.stdout:15.2.16-0.el8 2022-05-02T09:38:19.393 INFO:teuthology.packaging:The installed version of ceph is 15.2.16-0.el8 2022-05-02T09:38:19.393 INFO:teuthology.task.install:The correct ceph version 15.2.16-0 is installed. 2022-05-02T09:38:19.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2022-05-02T09:38:19.513 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2022-05-02T09:38:19.517 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:38:19.518 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:38:19.518 INFO:teuthology.packaging:ref: None 2022-05-02T09:38:19.518 INFO:teuthology.packaging:tag: None 2022-05-02T09:38:19.518 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:38:19.518 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:38:19.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:38:19.726 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-02T09:38:19.797 INFO:teuthology.orchestra.run.smithi073.stdout:15.2.16-0.el8 2022-05-02T09:38:19.797 INFO:teuthology.packaging:The installed version of ceph is 15.2.16-0.el8 2022-05-02T09:38:19.798 INFO:teuthology.task.install:The correct ceph version 15.2.16-0 is installed. 2022-05-02T09:38:19.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2022-05-02T09:38:19.926 INFO:teuthology.orchestra.run.smithi086.stdout:CentOSStream 2022-05-02T09:38:19.929 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:38:19.929 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-02T09:38:19.929 INFO:teuthology.packaging:ref: None 2022-05-02T09:38:19.929 INFO:teuthology.packaging:tag: None 2022-05-02T09:38:19.929 INFO:teuthology.packaging:branch: octopus 2022-05-02T09:38:19.929 INFO:teuthology.packaging:sha1: b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:38:19.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-05-02T09:38:20.138 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-02T09:38:20.207 INFO:teuthology.orchestra.run.smithi086.stdout:15.2.16-0.el8 2022-05-02T09:38:20.208 INFO:teuthology.packaging:The installed version of ceph is 15.2.16-0.el8 2022-05-02T09:38:20.208 INFO:teuthology.task.install:The correct ceph version 15.2.16-0 is installed. 2022-05-02T09:38:20.208 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-05-02T09:38:20.208 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:20.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-05-02T09:38:20.300 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:20.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-05-02T09:38:20.389 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:20.389 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-05-02T09:38:20.475 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-05-02T09:38:20.476 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:20.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2022-05-02T09:38:20.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-05-02T09:38:20.651 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:20.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2022-05-02T09:38:20.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-05-02T09:38:20.823 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:20.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2022-05-02T09:38:20.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-05-02T09:38:20.996 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-05-02T09:38:20.996 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:20.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2022-05-02T09:38:21.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-05-02T09:38:21.173 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:21.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2022-05-02T09:38:21.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-05-02T09:38:21.347 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:21.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2022-05-02T09:38:21.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-05-02T09:38:21.519 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:38:21.531 INFO:teuthology.task.print:**** done installing octopus 2022-05-02T09:38:21.531 INFO:teuthology.run_tasks:Running task ceph... 2022-05-02T09:38:21.619 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-05-02T09:38:21.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2022-05-02T09:38:21.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2022-05-02T09:38:21.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2022-05-02T09:38:21.715 INFO:tasks.ceph:Disabling ceph logrotate... 2022-05-02T09:38:21.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2022-05-02T09:38:21.721 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2022-05-02T09:38:21.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2022-05-02T09:38:21.816 INFO:tasks.ceph:Creating extra log directories... 2022-05-02T09:38:21.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-05-02T09:38:21.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-05-02T09:38:21.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-05-02T09:38:21.928 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-05-02T09:38:21.928 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-05-02T09:38:21.928 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6818446', 'branch': 'wip-vshankar-testing1-20220428-204527', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '6818446', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'vshankar-2022-05-02_09:11:25-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi', 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-20220428-204527'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'}}, 'nuke-on-error': False, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-20220428-204527', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-20220428-204527', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'targets': {'smithi050.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTYIAG/z0aDKFfEorkFkDho5mTe3vPVHkxxdAh0NfNnK4eDwI8HUd54Yqv/6tnThI7Y3bXGUHm6US0Vb2HcWiG71M1wpKgMfJGfgVRWnpZck06TBeMmtzHHeZXdGbg8S8uCRIDTg3agA49yeZ+Ax+8nG3HB/TVILinaLAtdxilfw4AmjmbxhM2dkxNlIkHeLSdi52LwG1drGyJdEwzKFPJcuTxnzeoMbgMoj3moqT7kiSZnTyLq+OC0GTqQsCGxpa5jW2+tWZhixhiAr/FuTSL73godOvo2n1joPwu+x5Av1zkAlpBlnT97fB34ebkb8cOAYvgPIkE9p0tCbx382Jlk6A2yl8SedcA6e4wceOmJatYhSfkpvPXWWXKLnh1dvj9lX4YdIG3BNUCKO9xPdoH/XvxAa4IFqhVAVmEwyGj1fkLHZ0VMB5aBSREvUqq6h7evQEdI6v1EoWBMzlovfihfMWWyU42BdNvawGUTJhXG4Rgun7Xd0ZVwgMpDp2P0=', 'smithi073.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMQVn6hj3HbI08xXZl+y52+njGA8SPVtV1MbjIGbJeMnH1/qpcry0zGoz9hXoLYg3TCCWI4sBUnCSpUFiieq1UR+IBuEK2Xy6BfURa1CdFmuviOnca4238sLsdgf2+oIBQxld2PesryjtNN1IWFC7bSjb4VrY4eWnWYPhGtLaLpg3XawSz7Tcx2C5Qakq0mhzRSP7u6T2Hv8XtADsQsukDmZgzZ4qKP8152RoUrZfw9OXplg+w6IXfhfZkXmPLgMFAkEGAIOwbpQhaNzzrB5T3z8o4dUW5Y8JUsPvvFeUtD9k0colBMjANXhGI4xkaD558bNJwyuL/etsGuozIM7pIE+LjjmtAGtDjgRnoUidkkvwtmtuQRDUQqG3qhUFXs5FcDJbQASsLYShCWJuQxmXvzeAcZCO82CRsVtpV+MjNW6BFbejT4fbxiGJ2pBALEG4lO0KnDjBUnru19HpG6WmQxa5i17J4Cq9RgI6GLVO77hgkODDGpFEgGZoWeqy2dIs=', 'smithi086.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ84gDDz/yOcq2FtGJv4OPfMFs5v6ke39sTAjQ2Jld7bRLpRZ+jkTDcfyo7pSBjNi6UPkRG1c6PzdIxKYhw7GhAwiPXHjWP5LA/kXLnXHGrvsycFbYFQ6071iEUa/XrDY0UpGkw+0XoISNgQuyDcQrXjqAeeLuHX50FkiBP/2It3KNnpI26p10mRPhP8m1bg+FHNfkBEvyeqQq9zQk1cUJXgUGkV1LYfTVjCuZNgNr1DFgwXDt5m0TVDR8DomqIaN0iCBHAhL9pxFleoA9e6n7k+2jWxd3qtlQLgJxGr3pH1wSpHMkc+i1jQctUMQwoquel9H2JcrJn3d/1wqBJ8EEykvK2aqg0HiJCEvTIeZwDjQgK3WWTUcEqWakgf1d4UtteYj8HMM0pQ25l4MulymgdJFDxbtwOtOs5cId5E0VVZQGZb5aIuc7R1uZ/4zAq7LyF/jQYl+Bfxp2NEN6kuiYy9yJoYfLHkMX+lUMmCTVttqY8h06q2UXjErzrevKkzU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5efacacc980658c97571abb0ce2f1ffc0c242411'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None, 'mon.b': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology_branch': 'master', 'teuthology_sha1': 'fd5c31669e51177d3c57bc0420279c5d1e944497', 'timestamp': '2022-05-02_09:11:25', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.5191'} 2022-05-02T09:38:21.929 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-05-02T09:38:21.934 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-05-02T09:38:21.942 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-05-02T09:38:21.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2022-05-02T09:38:22.004 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2022-05-02T09:38:22.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2022-05-02T09:38:22.096 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:22.096 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2022-05-02T09:38:22.156 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-05-02T09:38:22.156 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-05-02T09:38:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-05-02T09:38:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-02T09:38:22.214 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 450 Links: 1 2022-05-02T09:38:22.214 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-02T09:38:22.215 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2022-05-02T09:38:22.215 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2022-05-02 09:38:10.056962218 +0000 2022-05-02T09:38:22.215 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2022-05-02 09:35:11.832351288 +0000 2022-05-02T09:38:22.215 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2022-05-02 09:35:11.832351288 +0000 2022-05-02T09:38:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2022-05-02 09:35:11.800352082 +0000 2022-05-02T09:38:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2022-05-02T09:38:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2022-05-02T09:38:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000405658 s, 1.3 MB/s 2022-05-02T09:38:22.255 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-05-02T09:38:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-05-02T09:38:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 456 Links: 1 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2022-05-02 09:38:10.056962218 +0000 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2022-05-02 09:35:12.807327110 +0000 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2022-05-02 09:35:12.807327110 +0000 2022-05-02T09:38:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2022-05-02 09:35:12.774327928 +0000 2022-05-02T09:38:22.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2022-05-02T09:38:22.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2022-05-02T09:38:22.342 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000329022 s, 1.6 MB/s 2022-05-02T09:38:22.352 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 462 Links: 1 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2022-05-02 09:38:10.056962218 +0000 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2022-05-02 09:35:13.808302286 +0000 2022-05-02T09:38:22.410 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2022-05-02 09:35:13.808302286 +0000 2022-05-02T09:38:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2022-05-02 09:35:13.776303080 +0000 2022-05-02T09:38:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2022-05-02T09:38:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2022-05-02T09:38:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000320123 s, 1.6 MB/s 2022-05-02T09:38:22.450 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 468 Links: 1 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2022-05-02T09:38:22.508 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2022-05-02 09:38:10.056962218 +0000 2022-05-02T09:38:22.509 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2022-05-02 09:35:14.809277463 +0000 2022-05-02T09:38:22.509 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2022-05-02 09:35:14.809277463 +0000 2022-05-02T09:38:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2022-05-02 09:35:14.776278282 +0000 2022-05-02T09:38:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2022-05-02T09:38:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2022-05-02T09:38:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000318755 s, 1.6 MB/s 2022-05-02T09:38:22.547 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-02T09:38:22.547 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2022-05-02T09:38:22.547 INFO:tasks.ceph:Generating config... 2022-05-02T09:38:22.549 INFO:tasks.ceph:[global] mon warn on pool no app = False 2022-05-02T09:38:22.549 INFO:tasks.ceph:[global] ms bind msgr2 = False 2022-05-02T09:38:22.549 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2022-05-02T09:38:22.549 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2022-05-02T09:38:22.549 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2022-05-02T09:38:22.550 INFO:tasks.ceph:[client] client mount timeout = 600 2022-05-02T09:38:22.550 INFO:tasks.ceph:[client] debug client = 20 2022-05-02T09:38:22.550 INFO:tasks.ceph:[client] debug ms = 1 2022-05-02T09:38:22.550 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-05-02T09:38:22.550 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-05-02T09:38:22.550 INFO:tasks.ceph:[mds] debug mds = 20 2022-05-02T09:38:22.550 INFO:tasks.ceph:[mds] debug ms = 1 2022-05-02T09:38:22.550 INFO:tasks.ceph:[mds] mds debug frag = True 2022-05-02T09:38:22.550 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mgr] debug ms = 1 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mon] debug mon = 20 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mon] debug ms = 1 2022-05-02T09:38:22.551 INFO:tasks.ceph:[mon] debug paxos = 20 2022-05-02T09:38:22.552 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-05-02T09:38:22.552 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2022-05-02T09:38:22.552 INFO:tasks.ceph:[osd] bdev async discard = True 2022-05-02T09:38:22.552 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-05-02T09:38:22.552 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-05-02T09:38:22.552 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] debug ms = 1 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] debug osd = 20 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-05-02T09:38:22.553 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-05-02T09:38:22.554 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-05-02T09:38:22.554 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-05-02T09:38:22.554 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-05-02T09:38:22.554 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-05-02T09:38:22.554 INFO:tasks.ceph:Setting up mon.a... 2022-05-02T09:38:22.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-05-02T09:38:22.713 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2022-05-02T09:38:22.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-05-02T09:38:22.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-02T09:38:22.927 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'), ('mon.c', '[v2:172.21.15.50:3302,v1:172.21.15.50:6791]')] 2022-05-02T09:38:22.928 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],[v2:172.21.15.50:3302,v1:172.21.15.50:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-05-02T09:38:22.929 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:22.929 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-05-02T09:38:22.986 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --addv b '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --addv c '[v2:172.21.15.50:3302,v1:172.21.15.50:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:23.083 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:23.083 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 7c52b71c-589c-4ac2-936d-4a721101e437 2022-05-02T09:38:23.083 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2022-05-02T09:38:23.083 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 7c52b71c-589c-4ac2-936d-4a721101e437 2022-05-02T09:38:23.083 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2022-05-02T09:38:23.081548+0000 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:created 2022-05-02T09:38:23.081548+0000 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 0 (unknown) 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.b 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] mon.c 2022-05-02T09:38:23.084 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-05-02T09:38:23.089 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-05-02T09:38:23.146 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7c52b71c-589c-4ac2-936d-4a721101e437... 2022-05-02T09:38:23.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-05-02T09:38:23.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-05-02T09:38:23.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.297 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.298 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2022-05-02T09:38:23.299 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2022-05-02T09:38:23.300 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2022-05-02T09:38:23.301 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2022-05-02T09:38:23.302 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],[v2:172.21.15.50:3302,v1:172.21.15.50:6791]" 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: ms bind msgr2 = False 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore warn on legacy statfs = False 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore warn on no per pool omap = False 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn min per osd = 0 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 7c52b71c-589c-4ac2-936d-4a721101e437 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2022-05-02T09:38:23.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2022-05-02T09:38:23.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2022-05-02T09:38:23.305 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2022-05-02T09:38:23.306 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2022-05-02T09:38:23.307 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2022-05-02T09:38:23.308 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2022-05-02T09:38:23.309 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2022-05-02T09:38:23.310 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2022-05-02T09:38:23.311 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = False 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2022-05-02T09:38:23.312 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2022-05-02T09:38:23.313 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.314 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.315 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2022-05-02T09:38:23.315 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2022-05-02T09:38:23.315 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.316 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2022-05-02T09:38:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2022-05-02T09:38:23.318 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2022-05-02T09:38:23.319 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],[v2:172.21.15.50:3302,v1:172.21.15.50:6791]" 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on pool no app = False 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: ms bind msgr2 = False 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore warn on legacy statfs = False 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore warn on no per pool omap = False 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn min per osd = 0 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 7c52b71c-589c-4ac2-936d-4a721101e437 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2022-05-02T09:38:23.320 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2022-05-02T09:38:23.321 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.322 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2022-05-02T09:38:23.323 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2022-05-02T09:38:23.324 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2022-05-02T09:38:23.324 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2022-05-02T09:38:23.324 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2022-05-02T09:38:23.324 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.325 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2022-05-02T09:38:23.326 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.327 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2022-05-02T09:38:23.328 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = False 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-05-02T09:38:23.329 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2022-05-02T09:38:23.330 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.331 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2022-05-02T09:38:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],[v2:172.21.15.50:3302,v1:172.21.15.50:6791]" 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on pool no app = False 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: ms bind msgr2 = False 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore warn on legacy statfs = False 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore warn on no per pool omap = False 2022-05-02T09:38:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn min per osd = 0 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 7c52b71c-589c-4ac2-936d-4a721101e437 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2022-05-02T09:38:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2022-05-02T09:38:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2022-05-02T09:38:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2022-05-02T09:38:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-05-02T09:38:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = False 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2022-05-02T09:38:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2022-05-02T09:38:23.345 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2022-05-02T09:38:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2022-05-02T09:38:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2022-05-02T09:38:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2022-05-02T09:38:23.349 INFO:tasks.ceph:Creating admin key on mon.a... 2022-05-02T09:38:23.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-05-02T09:38:23.477 INFO:tasks.ceph:Copying monmap to all nodes... 2022-05-02T09:38:23.477 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:23.478 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-05-02T09:38:23.535 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:23.535 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-05-02T09:38:23.592 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:38:23.592 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:23.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2022-05-02T09:38:23.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-02T09:38:23.713 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:23.713 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:23.769 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2022-05-02T09:38:23.770 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:23.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2022-05-02T09:38:23.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-02T09:38:23.890 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:23.890 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:23.947 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2022-05-02T09:38:23.948 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:23.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2022-05-02T09:38:23.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-02T09:38:24.066 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:24.066 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:24.122 INFO:tasks.ceph:Setting up mon nodes... 2022-05-02T09:38:24.122 INFO:tasks.ceph:Setting up mgr nodes... 2022-05-02T09:38:24.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-05-02T09:38:24.267 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-05-02T09:38:24.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-05-02T09:38:24.418 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-05-02T09:38:24.426 INFO:tasks.ceph:Setting up mds nodes... 2022-05-02T09:38:24.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-05-02T09:38:24.571 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-05-02T09:38:24.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-05-02T09:38:24.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-05-02T09:38:24.820 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-05-02T09:38:24.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-05-02T09:38:24.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-05-02T09:38:25.060 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-05-02T09:38:25.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-05-02T09:38:25.155 INFO:tasks.ceph_client:Setting up client nodes... 2022-05-02T09:38:25.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-05-02T09:38:25.311 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-05-02T09:38:25.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-05-02T09:38:25.532 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-05-02T09:38:25.572 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-05-02T09:38:25.572 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2022-05-02T09:38:25.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-05-02T09:38:25.661 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-02T09:38:25.661 INFO:tasks.ceph:role: osd.0 2022-05-02T09:38:25.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:38:25.662 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-05-02T09:38:25.747 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-02T09:38:25.748 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-02T09:38:25.749 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-02T09:38:25.772 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2022-05-02T09:38:25.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2022-05-02T09:38:25.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-05-02T09:38:25.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-05-02T09:38:25.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-05-02T09:38:26.082 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-02T09:38:26.082 INFO:tasks.ceph:role: osd.1 2022-05-02T09:38:26.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:38:26.083 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-05-02T09:38:26.167 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-02T09:38:26.168 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-02T09:38:26.192 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2022-05-02T09:38:26.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2022-05-02T09:38:26.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-05-02T09:38:26.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-05-02T09:38:26.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-05-02T09:38:26.494 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-02T09:38:26.494 INFO:tasks.ceph:role: osd.2 2022-05-02T09:38:26.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:38:26.494 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-02T09:38:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-02T09:38:26.580 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-02T09:38:26.580 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-02T09:38:26.603 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2022-05-02T09:38:26.610 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2022-05-02T09:38:26.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-05-02T09:38:26.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-05-02T09:38:26.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-05-02T09:38:26.906 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-02T09:38:26.963 INFO:tasks.ceph:role: osd.3 2022-05-02T09:38:26.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:38:26.963 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-05-02T09:38:27.049 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-05-02T09:38:27.049 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-02T09:38:27.049 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-02T09:38:27.049 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-02T09:38:27.050 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-02T09:38:27.072 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2022-05-02T09:38:27.080 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2022-05-02T09:38:27.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-05-02T09:38:27.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-05-02T09:38:27.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:27.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.419+0000 7f47cc938f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-05-02T09:38:27.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.420+0000 7f47cc938f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-05-02T09:38:27.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.420+0000 7f47cc938f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-02T09:38:27.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.420+0000 7f47cc938f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-02T09:38:27.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.420+0000 7f47cc938f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-02T09:38:27.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.422+0000 7f47cc938f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-05-02T09:38:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:27.438+0000 7f47cc938f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-05-02T09:38:30.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-05-02T09:38:30.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:30.283 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.281+0000 7fa9c9bcdf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-05-02T09:38:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.281+0000 7fa9c9bcdf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-05-02T09:38:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.281+0000 7fa9c9bcdf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-02T09:38:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.281+0000 7fa9c9bcdf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-02T09:38:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.281+0000 7fa9c9bcdf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-02T09:38:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.283+0000 7fa9c9bcdf00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-05-02T09:38:30.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:30.297+0000 7fa9c9bcdf00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-05-02T09:38:32.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-05-02T09:38:33.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:33.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.138+0000 7f39c81a7f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-05-02T09:38:33.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.138+0000 7f39c81a7f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-05-02T09:38:33.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.138+0000 7f39c81a7f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-02T09:38:33.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.139+0000 7f39c81a7f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-02T09:38:33.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.139+0000 7f39c81a7f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-02T09:38:33.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.140+0000 7f39c81a7f00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-05-02T09:38:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:33.154+0000 7f39c81a7f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-05-02T09:38:35.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-05-02T09:38:35.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.001+0000 7f6c1a5c6f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-05-02T09:38:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.001+0000 7f6c1a5c6f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-05-02T09:38:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.001+0000 7f6c1a5c6f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-02T09:38:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.001+0000 7f6c1a5c6f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-02T09:38:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.001+0000 7f6c1a5c6f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-02T09:38:36.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.003+0000 7f6c1a5c6f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-05-02T09:38:36.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:36.017+0000 7f6c1a5c6f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-05-02T09:38:38.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-05-02T09:38:38.745 INFO:tasks.ceph:Reading keys from all nodes... 2022-05-02T09:38:38.746 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:38.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-05-02T09:38:38.834 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:38.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-05-02T09:38:38.922 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-05-02T09:38:39.099 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-05-02T09:38:39.186 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-05-02T09:38:39.274 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-05-02T09:38:39.360 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-05-02T09:38:39.446 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-05-02T09:38:39.533 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:39.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-05-02T09:38:39.620 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2022-05-02T09:38:39.620 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-05-02T09:38:39.682 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2022-05-02T09:38:39.682 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-05-02T09:38:39.743 INFO:tasks.ceph:Adding keys to all mons... 2022-05-02T09:38:39.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2022-05-02T09:38:39.826 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2022-05-02T09:38:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCQpm9iJw3UDxAAaKOHYRvOzPh3DhJ9bz7geQ== 2022-05-02T09:38:39.826 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2022-05-02T09:38:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCQpm9iwIDhGBAAPA8cCaaFT9v2/01G5UzxNg== 2022-05-02T09:38:39.826 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCQpm9iRjDuIRAAZFfiIsg06Hk+2Mj/1fwBrA== 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCQpm9i06bKMBAAdq19NYMcrot15pWOvm1HJw== 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCRpm9iIw6AAxAAxSFnfLwccbgxguoqtVWsWw== 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCTpm9i0Y4RGRAAGPcbDJWbdrA4eXEId20N+g== 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2022-05-02T09:38:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCWpm9ie7PMEBAAhQu8tU6xoSg6luS2ZiHjEA== 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCZpm9ifXZJCBAAybOctm7a4azp0jl3q/HVzw== 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCcpm9iKYwiABAAGX/uPOaYENrx199vcaEMNg== 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2022-05-02T09:38:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCRpm9i2Dh9EhAAEFd57GpCYbZI8nY/UbkHLg== 2022-05-02T09:38:39.829 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2022-05-02T09:38:39.829 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCRpm9i236tHxAAzilGBISDIWivrYhUHnWDPg== 2022-05-02T09:38:39.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-02T09:38:39.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-02T09:38:40.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-02T09:38:40.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-02T09:38:40.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-02T09:38:40.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-02T09:38:40.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-02T09:38:40.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-02T09:38:40.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-02T09:38:40.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-02T09:38:41.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-02T09:38:41.234 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-05-02T09:38:41.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-05-02T09:38:41.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-02T09:38:41.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-05-02T09:38:41.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-05-02T09:38:41.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-02T09:38:41.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-05-02T09:38:41.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-05-02T09:38:41.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-02T09:38:42.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-05-02T09:38:42.226 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-05-02T09:38:42.282 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-05-02T09:38:42.283 INFO:tasks.ceph.mon.a:Restarting daemon 2022-05-02T09:38:42.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-05-02T09:38:42.288 INFO:tasks.ceph.mon.a:Started 2022-05-02T09:38:42.289 INFO:tasks.ceph.mon.b:Restarting daemon 2022-05-02T09:38:42.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-05-02T09:38:42.293 INFO:tasks.ceph.mon.b:Started 2022-05-02T09:38:42.293 INFO:tasks.ceph.mon.c:Restarting daemon 2022-05-02T09:38:42.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-05-02T09:38:42.299 INFO:tasks.ceph.mon.c:Started 2022-05-02T09:38:42.299 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-05-02T09:38:42.299 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-05-02T09:38:42.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-05-02T09:38:42.306 INFO:tasks.ceph.mgr.x:Started 2022-05-02T09:38:42.306 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-05-02T09:38:42.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-05-02T09:38:42.314 INFO:tasks.ceph.mgr.y:Started 2022-05-02T09:38:42.314 INFO:tasks.ceph:Setting crush tunables to default 2022-05-02T09:38:42.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2022-05-02T09:38:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.599+0000 7f3ef9f9d700 1 Processor -- start 2022-05-02T09:38:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.599+0000 7f3ef9f9d700 1 -- start start 2022-05-02T09:38:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef9f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef9f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef9f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef40618b0 con 0x7f3ef4135a10 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef9f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef4061b50 con 0x7f3ef4132d80 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef9f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef409b950 con 0x7f3ef4133160 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef8f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef8f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35456/0 (socket says 172.21.15.50:35456) 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 learned_addr learned my addr 172.21.15.50:0/2747220183 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.600+0000 7f3ef979c700 1 --1- 172.21.15.50:0/2747220183 >> v1:172.21.15.50:6789/0 conn(0x7f3ef4135a10 0x7f3ef4135ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52088/0 (socket says 172.21.15.50:52088) 2022-05-02T09:38:42.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:38:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.601+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:38:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:38:42.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:42.802+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:38:43.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:43.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:43.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:38:43.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:43.203+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:38:44.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.004+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.004+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.004+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.004+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.004+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.005+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.005+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.005+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.005+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:38:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:44.005+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3ef409a5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3ef409a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3ef4061290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3ef4061290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 >> v1:172.21.15.50:6789/0 conn(0x7f3ef4135a10 legacy=0x7f3ef4135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4061b50 con 0x7f3edc003380 2022-05-02T09:38:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.601+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:38:45.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:45.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.802+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:45.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.802+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:45.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:45.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:45.802+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:38:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:46.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:46.203+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:46.203+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:46.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:46.203+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:38:47.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:47.005+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:47.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:47.005+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:38:47.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:47.005+0000 7f3ef8f9b700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:38:47.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:47.005+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-05-02T09:38:47.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:47.005+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:38:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.599+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 msgr2=0x7f3edc0057d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:38:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.599+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.599+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3edc007ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef27fc700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3edc00dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef409bac0 con 0x7f3ef4135a10 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef4061b50 con 0x7f3ef4132d80 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef27fc700 1 -- 172.21.15.50:0/2747220183 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef409b950 con 0x7f3ef4133160 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef979c700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3edc00dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef8f9b700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3edc007ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef37fe700 1 -- 172.21.15.50:0/2747220183 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986202031 0 0) 0x7f3ef409bac0 con 0x7f3ef4135a10 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.600+0000 7f3ef37fe700 1 -- 172.21.15.50:0/2747220183 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003260 con 0x7f3ef4135a10 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef979c700 1 -- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 msgr2=0x7f3edc007ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef979c700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3edc007ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef979c700 1 -- 172.21.15.50:0/2747220183 >> v1:172.21.15.50:6789/0 conn(0x7f3ef4135a10 legacy=0x7f3edc00a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef979c700 1 -- 172.21.15.50:0/2747220183 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc00f280 con 0x7f3ef4133160 2022-05-02T09:38:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef979c700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3edc00dcc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3ef406c2a0 tx=0x7f3eec007f00).ready entity=mon.2 client_cookie=bd35998f9f15e2e6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:48.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef37fe700 1 -- 172.21.15.50:0/2747220183 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eec005ae0 con 0x7f3ef4133160 2022-05-02T09:38:48.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef37fe700 1 -- 172.21.15.50:0/2747220183 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec005c40 con 0x7f3ef4133160 2022-05-02T09:38:48.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.601+0000 7f3ef37fe700 1 -- 172.21.15.50:0/2747220183 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eec007110 con 0x7f3ef4133160 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 msgr2=0x7f3edc00dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3edc00dcc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3ef406c2a0 tx=0x7f3eec007f00).stop 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2747220183 shutdown_connections 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ef4133160 0x7f3edc00dcc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2747220183 >> v2:172.21.15.50:3300/0 conn(0x7f3ef4132d80 0x7f3edc007ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2747220183 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3edc003380 0x7f3edc0057d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2747220183 >> 172.21.15.50:0/2747220183 conn(0x7f3ef406c300 msgr2=0x7f3ef40a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2747220183 shutdown_connections 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.602+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2747220183 wait complete. 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.604+0000 7f3ef9f9d700 1 Processor -- start 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.604+0000 7f3ef9f9d700 1 -- start start 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3edc003380 0x7f3ef413cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ef4133160 0x7f3ef412ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef413c810 con 0x7f3ef4132d80 2022-05-02T09:38:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4092390 con 0x7f3ef4133160 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef9f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4092cd0 con 0x7f3edc003380 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef979c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ef4133160 0x7f3ef412ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef8f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3edc003380 0x7f3ef413cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35486/0 (socket says 172.21.15.50:35486) 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.605+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2683489516 learned_addr learned my addr 172.21.15.50:0/2683489516 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3edc003380 msgr2=0x7f3ef413cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3edc003380 0x7f3ef413cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ef4133160 msgr2=0x7f3ef412ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ef4133160 0x7f3ef412ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 -- 172.21.15.50:0/2683489516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40618b0 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef3fff700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3ee0007000 tx=0x7f3ee0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0016860 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0000e90 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef4092f70 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.606+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0016bb0 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.607+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef41304a0 con 0x7f3ef4132d80 2022-05-02T09:38:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.607+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f3ee0012040 con 0x7f3ef4132d80 2022-05-02T09:38:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.607+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3ee001fac0 con 0x7f3ef4132d80 2022-05-02T09:38:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.608+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef4057990 con 0x7f3ef4132d80 2022-05-02T09:38:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.611+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3ee001a030 con 0x7f3ef4132d80 2022-05-02T09:38:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.691+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3ef4060df0 con 0x7f3ef4132d80 2022-05-02T09:38:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.695+0000 7f3ef1ffb700 1 -- 172.21.15.50:0/2683489516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3ee0028420 con 0x7f3ef4132d80 2022-05-02T09:38:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 msgr2=0x7f3ef412fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3ee0007000 tx=0x7f3ee0008040).stop 2022-05-02T09:38:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 shutdown_connections 2022-05-02T09:38:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3edc003380 0x7f3ef413cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ef4133160 0x7f3ef412ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 --2- 172.21.15.50:0/2683489516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef4132d80 0x7f3ef412fac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 >> 172.21.15.50:0/2683489516 conn(0x7f3ef406c300 msgr2=0x7f3ef4131fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 shutdown_connections 2022-05-02T09:38:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:48.696+0000 7f3ef9f9d700 1 -- 172.21.15.50:0/2683489516 wait complete. 2022-05-02T09:38:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2022-05-02T09:38:48.724 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-05-02T09:38:48.725 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:48.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-05-02T09:38:48.832 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:48.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-05-02T09:38:48.928 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:48.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-05-02T09:38:49.018 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:38:49.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-05-02T09:38:49.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 5052e124-3372-47ca-82bf-129e055505ff 0 2022-05-02T09:38:49.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.320+0000 7fbad359d700 1 Processor -- start 2022-05-02T09:38:49.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.320+0000 7fbad359d700 1 -- start start 2022-05-02T09:38:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc139720 0x7fbacc05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 0x7fbacc1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad359d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc05d360 con 0x7fbacc139b00 2022-05-02T09:38:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc139010 con 0x7fbacc05d7d0 2022-05-02T09:38:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1392d0 con 0x7fbacc139720 2022-05-02T09:38:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad2d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 0x7fbacc1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc139720 0x7fbacc05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.321+0000 7fbad1d9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbacc139b00 0x7fbacc05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52098/0 (socket says 172.21.15.50:52098) 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad1d9a700 1 -- 172.21.15.50:0/305134390 learned_addr learned my addr 172.21.15.50:0/305134390 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad2d9c700 1 -- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc139720 msgr2=0x7fbacc05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad2d9c700 1 --2- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc139720 0x7fbacc05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad2d9c700 1 -- 172.21.15.50:0/305134390 >> v1:172.21.15.50:6789/0 conn(0x7fbacc139b00 legacy=0x7fbacc05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad2d9c700 1 -- 172.21.15.50:0/305134390 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0a7c50 con 0x7fbacc05d7d0 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.322+0000 7fbad1599700 1 -- 172.21.15.50:0/305134390 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578590145 0 0) 0x7fbacc05d360 con 0x7fbacc139b00 2022-05-02T09:38:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad2d9c700 1 --2- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 0x7fbacc1402a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbac40032f0 tx=0x7fbac40091d0).ready entity=mon.1 client_cookie=6091ac3bf53fe6ff server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad1599700 1 -- 172.21.15.50:0/305134390 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac400b6c0 con 0x7fbacc05d7d0 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad1599700 1 -- 172.21.15.50:0/305134390 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400b820 con 0x7fbacc05d7d0 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad1599700 1 -- 172.21.15.50:0/305134390 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac400b990 con 0x7fbacc05d7d0 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad359d700 1 -- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 msgr2=0x7fbacc1402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.323+0000 7fbad359d700 1 --2- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 0x7fbacc1402a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbac40032f0 tx=0x7fbac40091d0).stop 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 -- 172.21.15.50:0/305134390 shutdown_connections 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 --2- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc05d7d0 0x7fbacc1402a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 --2- 172.21.15.50:0/305134390 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc139720 0x7fbacc05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 -- 172.21.15.50:0/305134390 >> 172.21.15.50:0/305134390 conn(0x7fbacc0669d0 msgr2=0x7fbacc0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 -- 172.21.15.50:0/305134390 shutdown_connections 2022-05-02T09:38:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.324+0000 7fbad359d700 1 -- 172.21.15.50:0/305134390 wait complete. 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.325+0000 7fbad359d700 1 Processor -- start 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.325+0000 7fbad359d700 1 -- start start 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 0x7fbacc136150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc139b00 0x7fbacc12c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0a0bf0 con 0x7fbacc139720 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0a0eb0 con 0x7fbacc139b00 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc136640 con 0x7fbacc05d7d0 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.326+0000 7fbad259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49402/0 (socket says 172.21.15.50:49402) 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 -- 172.21.15.50:0/672440711 learned_addr learned my addr 172.21.15.50:0/672440711 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad2d9c700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc139b00 0x7fbacc12c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad1d9a700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 0x7fbacc136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 -- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc139b00 msgr2=0x7fbacc12c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc139b00 0x7fbacc12c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 -- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 msgr2=0x7fbacc136150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 0x7fbacc136150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad259b700 1 -- 172.21.15.50:0/672440711 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009470 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.327+0000 7fbad1d9a700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 0x7fbacc136150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbad259b700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbac800c000 tx=0x7fbac8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8010780 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80108e0 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8010c40 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc0a0840 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc0a6720 con 0x7fbacc05d7d0 2022-05-02T09:38:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.328+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fbac801c460 con 0x7fbacc05d7d0 2022-05-02T09:38:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.329+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbac80123f0 con 0x7fbacc05d7d0 2022-05-02T09:38:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.329+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc0a20a0 con 0x7fbacc05d7d0 2022-05-02T09:38:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.332+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fbac80125b0 con 0x7fbacc05d7d0 2022-05-02T09:38:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.418+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd new", "uuid": "5052e124-3372-47ca-82bf-129e055505ff", "id": 0} v 0) v1 -- 0x7fbacc057990 con 0x7fbacc05d7d0 2022-05-02T09:38:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.422+0000 7fbabb7fe700 1 -- 172.21.15.50:0/672440711 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5052e124-3372-47ca-82bf-129e055505ff", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbac8006020 con 0x7fbacc05d7d0 2022-05-02T09:38:49.425 INFO:teuthology.orchestra.run.smithi050.stdout:0 2022-05-02T09:38:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.423+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 msgr2=0x7fbacc0a2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.423+0000 7fbad359d700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbac800c000 tx=0x7fbac8006df0).stop 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 shutdown_connections 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbacc05d7d0 0x7fbacc0a2730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbacc139b00 0x7fbacc12c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 --2- 172.21.15.50:0/672440711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbacc139720 0x7fbacc136150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 >> 172.21.15.50:0/672440711 conn(0x7fbacc0669d0 msgr2=0x7fbacc1375b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 shutdown_connections 2022-05-02T09:38:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.424+0000 7fbad359d700 1 -- 172.21.15.50:0/672440711 wait complete. 2022-05-02T09:38:49.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 977ab153-0005-4d17-87fd-513b8e54c8a5 1 2022-05-02T09:38:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.656+0000 7f65b099d700 1 Processor -- start 2022-05-02T09:38:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.656+0000 7f65b099d700 1 -- start start 2022-05-02T09:38:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.657+0000 7f65b099d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 0x7f65ac05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.657+0000 7f65b099d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65ac05d7d0 0x7f65ac1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.657+0000 7f65b099d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac05d360 con 0x7f65ac139b00 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.657+0000 7f65b099d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac139010 con 0x7f65ac05d7d0 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.657+0000 7f65b099d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac1392d0 con 0x7f65ac139720 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65ab7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 0x7f65ac05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65abfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65ac05d7d0 0x7f65ac1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65aaffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f65ac139b00 0x7f65ac05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52100/0 (socket says 172.21.15.50:52100) 2022-05-02T09:38:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65aaffd700 1 -- 172.21.15.50:0/1298425406 learned_addr learned my addr 172.21.15.50:0/1298425406 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65aa7fc700 1 -- 172.21.15.50:0/1298425406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838298944 0 0) 0x7f65ac05d360 con 0x7f65ac139b00 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.658+0000 7f65aa7fc700 1 -- 172.21.15.50:0/1298425406 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6598003260 con 0x7f65ac139b00 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65abfff700 1 -- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 msgr2=0x7f65ac05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65abfff700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 0x7f65ac05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65abfff700 1 -- 172.21.15.50:0/1298425406 >> v1:172.21.15.50:6789/0 conn(0x7f65ac139b00 legacy=0x7f65ac05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65abfff700 1 -- 172.21.15.50:0/1298425406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0a7c50 con 0x7f65ac05d7d0 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65ab7fe700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 0x7f65ac05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65abfff700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac05d7d0 0x7f65ac1402a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65a40032f0 tx=0x7f65a40091d0).ready entity=mon.0 client_cookie=29c138b271de693a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65aa7fc700 1 -- 172.21.15.50:0/1298425406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a400b600 con 0x7f65ac05d7d0 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65aa7fc700 1 -- 172.21.15.50:0/1298425406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a400b760 con 0x7f65ac05d7d0 2022-05-02T09:38:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.659+0000 7f65aa7fc700 1 -- 172.21.15.50:0/1298425406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a400b8d0 con 0x7f65ac05d7d0 2022-05-02T09:38:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 -- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac05d7d0 msgr2=0x7f65ac1402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac05d7d0 0x7f65ac1402a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65a40032f0 tx=0x7f65a40091d0).stop 2022-05-02T09:38:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 -- 172.21.15.50:0/1298425406 shutdown_connections 2022-05-02T09:38:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac05d7d0 0x7f65ac1402a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 --2- 172.21.15.50:0/1298425406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac139720 0x7f65ac05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 -- 172.21.15.50:0/1298425406 >> 172.21.15.50:0/1298425406 conn(0x7f65ac0669d0 msgr2=0x7f65ac0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:49.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 -- 172.21.15.50:0/1298425406 shutdown_connections 2022-05-02T09:38:49.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.660+0000 7f65b099d700 1 -- 172.21.15.50:0/1298425406 wait complete. 2022-05-02T09:38:49.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.662+0000 7f65b099d700 1 Processor -- start 2022-05-02T09:38:49.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.662+0000 7f65b099d700 1 -- start start 2022-05-02T09:38:49.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac139720 0x7f65ac0a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 0x7f65ac0a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0a34c0 con 0x7f65ac139720 2022-05-02T09:38:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0a2940 con 0x7f65ac05d7d0 2022-05-02T09:38:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65b099d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0a3f30 con 0x7f65ac139b00 2022-05-02T09:38:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65ab7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65ab7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50082/0 (socket says 172.21.15.50:50082) 2022-05-02T09:38:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65ab7fe700 1 -- 172.21.15.50:0/1531617333 learned_addr learned my addr 172.21.15.50:0/1531617333 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65abfff700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 0x7f65ac0a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.663+0000 7f65aaffd700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac139720 0x7f65ac0a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 -- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 msgr2=0x7f65ac0a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 0x7f65ac0a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 -- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac139720 msgr2=0x7f65ac0a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac139720 0x7f65ac0a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 -- 172.21.15.50:0/1531617333 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c00b180 con 0x7f65ac05d7d0 2022-05-02T09:38:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65abfff700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 0x7f65ac0a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65ab7fe700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f659c00c000 tx=0x7f659c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.664+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659c010590 con 0x7f65ac05d7d0 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c0106f0 con 0x7f65ac05d7d0 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a4009470 con 0x7f65ac05d7d0 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659c010a50 con 0x7f65ac05d7d0 2022-05-02T09:38:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac0a3990 con 0x7f65ac05d7d0 2022-05-02T09:38:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f659c01c460 con 0x7f65ac05d7d0 2022-05-02T09:38:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.665+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f659c0127b0 con 0x7f65ac05d7d0 2022-05-02T09:38:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.666+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac0a6690 con 0x7f65ac05d7d0 2022-05-02T09:38:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.669+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f659c010d80 con 0x7f65ac05d7d0 2022-05-02T09:38:49.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.750+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "977ab153-0005-4d17-87fd-513b8e54c8a5", "id": 1} v 0) v1 -- 0x7f65ac057990 con 0x7f65ac05d7d0 2022-05-02T09:38:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.754+0000 7f65a8ff9700 1 -- 172.21.15.50:0/1531617333 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "977ab153-0005-4d17-87fd-513b8e54c8a5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f659c012970 con 0x7f65ac05d7d0 2022-05-02T09:38:49.757 INFO:teuthology.orchestra.run.smithi050.stdout:1 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 msgr2=0x7f65ac0a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f659c00c000 tx=0x7f659c006df0).stop 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 shutdown_connections 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f65ac139b00 0x7f65ac0a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65ac05d7d0 0x7f65ac0a4c10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 --2- 172.21.15.50:0/1531617333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65ac139720 0x7f65ac0a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 >> 172.21.15.50:0/1531617333 conn(0x7f65ac0669d0 msgr2=0x7f65ac05cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 shutdown_connections 2022-05-02T09:38:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.755+0000 7f65b099d700 1 -- 172.21.15.50:0/1531617333 wait complete. 2022-05-02T09:38:49.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 967bcdc5-8577-484e-bdd1-09a1ccdcad37 2 2022-05-02T09:38:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.984+0000 7f8ec93ff700 1 Processor -- start 2022-05-02T09:38:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.984+0000 7f8ec93ff700 1 -- start start 2022-05-02T09:38:49.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 0x7f8ec4094490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec4137930 0x7f8ec4133b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec4099d90 con 0x7f8ec4137930 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4094e60 con 0x7f8ec4137530 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec93ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4095100 con 0x7f8ec40994c0 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec27fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 0x7f8ec4094490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.985+0000 7f8ec2ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec4137930 0x7f8ec4133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49406/0 (socket says 172.21.15.50:49406) 2022-05-02T09:38:49.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 -- 172.21.15.50:0/2790646707 learned_addr learned my addr 172.21.15.50:0/2790646707 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec27fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 0x7f8ec4094490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50084/0 (socket says 172.21.15.50:50084) 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 -- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 msgr2=0x7f8ec4094490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 --2- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 0x7f8ec4094490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 -- 172.21.15.50:0/2790646707 >> v2:172.21.15.50:3300/0 conn(0x7f8ec4137930 msgr2=0x7f8ec4133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 --2- 172.21.15.50:0/2790646707 >> v2:172.21.15.50:3300/0 conn(0x7f8ec4137930 0x7f8ec4133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 -- 172.21.15.50:0/2790646707 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4095920 con 0x7f8ec40994c0 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.986+0000 7f8ec2ffd700 1 --2- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8eb4002f70 tx=0x7f8eb4006eb0).ready entity=mon.2 client_cookie=83a1ed6c694f37c8 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec1ffb700 1 -- 172.21.15.50:0/2790646707 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb400d570 con 0x7f8ec40994c0 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec1ffb700 1 -- 172.21.15.50:0/2790646707 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb4000e90 con 0x7f8ec40994c0 2022-05-02T09:38:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec1ffb700 1 -- 172.21.15.50:0/2790646707 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb400d900 con 0x7f8ec40994c0 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 msgr2=0x7f8ec40998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8eb4002f70 tx=0x7f8eb4006eb0).stop 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2790646707 shutdown_connections 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2790646707 >> v2:172.21.15.50:3300/0 conn(0x7f8ec4137930 0x7f8ec4133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec40994c0 0x7f8ec40998a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2790646707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137530 0x7f8ec4094490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.987+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2790646707 >> 172.21.15.50:0/2790646707 conn(0x7f8ec40a7e80 msgr2=0x7f8ec40a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.988+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2790646707 shutdown_connections 2022-05-02T09:38:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.988+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2790646707 wait complete. 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.989+0000 7f8ec93ff700 1 Processor -- start 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.989+0000 7f8ec93ff700 1 -- start start 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 0x7f8ec4133b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137930 0x7f8ec4065db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4149010 con 0x7f8ec40994c0 2022-05-02T09:38:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4093820 con 0x7f8ec4137930 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec93ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4134030 con 0x7f8ec4137530 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35496/0 (socket says 172.21.15.50:35496) 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec2ffd700 1 -- 172.21.15.50:0/2626406680 learned_addr learned my addr 172.21.15.50:0/2626406680 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec27fc700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 0x7f8ec4133b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.990+0000 7f8ec37fe700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137930 0x7f8ec4065db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 -- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137930 msgr2=0x7f8ec4065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137930 0x7f8ec4065db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 -- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 msgr2=0x7f8ec41345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 -- 172.21.15.50:0/2626406680 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb400b1e0 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec2ffd700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.991+0000 7f8ec27fc700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 0x7f8ec4133b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8eb800c000 tx=0x7f8eb8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb8011750 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80118b0 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec40662a0 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb8011c10 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec41494d0 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f8eb801c460 con 0x7f8ec4137530 2022-05-02T09:38:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.992+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f8eb80123f0 con 0x7f8ec4137530 2022-05-02T09:38:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.994+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4133860 con 0x7f8ec4137530 2022-05-02T09:38:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:49.998+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8eb801cb00 con 0x7f8ec4137530 2022-05-02T09:38:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.101+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd new", "uuid": "967bcdc5-8577-484e-bdd1-09a1ccdcad37", "id": 2} v 0) v1 -- 0x7f8ec4066430 con 0x7f8ec4137530 2022-05-02T09:38:50.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.106+0000 7f8eb3fff700 1 -- 172.21.15.50:0/2626406680 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "967bcdc5-8577-484e-bdd1-09a1ccdcad37", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ec4066430 con 0x7f8ec4137530 2022-05-02T09:38:50.110 INFO:teuthology.orchestra.run.smithi050.stdout:2 2022-05-02T09:38:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 msgr2=0x7f8ec4133b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 0x7f8ec4133b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8eb800c000 tx=0x7f8eb8006df0).stop 2022-05-02T09:38:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 shutdown_connections 2022-05-02T09:38:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ec4137930 0x7f8ec4065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec40994c0 0x7f8ec41345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 --2- 172.21.15.50:0/2626406680 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8ec4137530 0x7f8ec4133b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.107+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 >> 172.21.15.50:0/2626406680 conn(0x7f8ec40a7e80 msgr2=0x7f8ec40a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:50.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.108+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 shutdown_connections 2022-05-02T09:38:50.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.108+0000 7f8ec93ff700 1 -- 172.21.15.50:0/2626406680 wait complete. 2022-05-02T09:38:50.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 14b35f6e-2868-4cbd-81c5-d6cb8807774f 3 2022-05-02T09:38:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.337+0000 7f8cddb9d700 1 Processor -- start 2022-05-02T09:38:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.337+0000 7f8cddb9d700 1 -- start start 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cddb9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 0x7f8cd809a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cddb9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 0x7f8cd81406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cddb9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80618b0 con 0x7f8cd8132d80 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cddb9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8061690 con 0x7f8cd8061290 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cddb9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8061b50 con 0x7f8cd813e2d0 2022-05-02T09:38:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cdcb9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cd8132d80 0x7f8cd8133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52102/0 (socket says 172.21.15.50:52102) 2022-05-02T09:38:50.343 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cdcb9b700 1 -- 172.21.15.50:0/3831838004 learned_addr learned my addr 172.21.15.50:0/3831838004 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:38:50.343 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.338+0000 7f8cdd39c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 0x7f8cd81406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.343 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cd7fff700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 0x7f8cd809a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cdd39c700 1 -- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 msgr2=0x7f8cd809a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cdd39c700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 0x7f8cd809a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cdd39c700 1 -- 172.21.15.50:0/3831838004 >> v1:172.21.15.50:6789/0 conn(0x7f8cd8132d80 legacy=0x7f8cd8133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cd77fe700 1 -- 172.21.15.50:0/3831838004 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215661740 0 0) 0x7f8cd80618b0 con 0x7f8cd8132d80 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cdd39c700 1 -- 172.21.15.50:0/3831838004 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd809b950 con 0x7f8cd813e2d0 2022-05-02T09:38:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cd7fff700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 0x7f8cd809a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.339+0000 7f8cdd39c700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 0x7f8cd81406c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8cd80617d0 tx=0x7f8cd00091d0).ready entity=mon.2 client_cookie=13cfba3a86581a62 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.340+0000 7f8cd77fe700 1 -- 172.21.15.50:0/3831838004 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd000b860 con 0x7f8cd813e2d0 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.340+0000 7f8cd77fe700 1 -- 172.21.15.50:0/3831838004 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000b9c0 con 0x7f8cd813e2d0 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.340+0000 7f8cd77fe700 1 -- 172.21.15.50:0/3831838004 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd000bb30 con 0x7f8cd813e2d0 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.340+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 msgr2=0x7f8cd81406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.340+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 0x7f8cd81406c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8cd80617d0 tx=0x7f8cd00091d0).stop 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3831838004 shutdown_connections 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd813e2d0 0x7f8cd81406c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3831838004 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd8061290 0x7f8cd809a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3831838004 >> 172.21.15.50:0/3831838004 conn(0x7f8cd806c300 msgr2=0x7f8cd80a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3831838004 shutdown_connections 2022-05-02T09:38:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.341+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3831838004 wait complete. 2022-05-02T09:38:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.342+0000 7f8cddb9d700 1 Processor -- start 2022-05-02T09:38:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.342+0000 7f8cddb9d700 1 -- start start 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd8061290 0x7f8cd81360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 0x7f8cd8145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8144d80 con 0x7f8cd8132d80 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd813b200 con 0x7f8cd813e2d0 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cddb9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd813afe0 con 0x7f8cd8061290 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cdcb9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd8061290 0x7f8cd81360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35500/0 (socket says 172.21.15.50:35500) 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.344+0000 7f8cd7fff700 1 -- 172.21.15.50:0/3316421605 learned_addr learned my addr 172.21.15.50:0/3316421605 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cdd39c700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 0x7f8cd8145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 -- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd8061290 msgr2=0x7f8cd81360b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd8061290 0x7f8cd81360b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 -- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 msgr2=0x7f8cd8145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 0x7f8cd8145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 -- 172.21.15.50:0/3316421605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0009470 con 0x7f8cd8132d80 2022-05-02T09:38:50.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cdd39c700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 0x7f8cd8145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.345+0000 7f8cd7fff700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8cc4007000 tx=0x7f8cc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.346+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc4010650 con 0x7f8cd8132d80 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.346+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40107b0 con 0x7f8cd8132d80 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.346+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc4010b10 con 0x7f8cd8132d80 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.346+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd813baf0 con 0x7f8cd8132d80 2022-05-02T09:38:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.346+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd813a8f0 con 0x7f8cd8132d80 2022-05-02T09:38:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.347+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 2) v1 ==== 20790+0+0 (secure 0 0 0) 0x7f8cc4010c70 con 0x7f8cd8132d80 2022-05-02T09:38:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.348+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f8cc4029da0 con 0x7f8cd8132d80 2022-05-02T09:38:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.348+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd8057990 con 0x7f8cd8132d80 2022-05-02T09:38:50.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.352+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8cc4019cb0 con 0x7f8cd8132d80 2022-05-02T09:38:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.459+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14b35f6e-2868-4cbd-81c5-d6cb8807774f", "id": 3} v 0) v1 -- 0x7f8cd813b340 con 0x7f8cd8132d80 2022-05-02T09:38:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.463+0000 7f8cd5ffb700 1 -- 172.21.15.50:0/3316421605 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14b35f6e-2868-4cbd-81c5-d6cb8807774f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8cc4017a10 con 0x7f8cd8132d80 2022-05-02T09:38:50.467 INFO:teuthology.orchestra.run.smithi050.stdout:3 2022-05-02T09:38:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 msgr2=0x7f8cd8145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8cc4007000 tx=0x7f8cc4008040).stop 2022-05-02T09:38:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 shutdown_connections 2022-05-02T09:38:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cd8061290 0x7f8cd81360b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cd813e2d0 0x7f8cd8145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 --2- 172.21.15.50:0/3316421605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8132d80 0x7f8cd8145130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.465+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 >> 172.21.15.50:0/3316421605 conn(0x7f8cd806c300 msgr2=0x7f8cd805fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.466+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 shutdown_connections 2022-05-02T09:38:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.466+0000 7f8cddb9d700 1 -- 172.21.15.50:0/3316421605 wait complete. 2022-05-02T09:38:50.492 INFO:tasks.ceph.osd.0:Restarting daemon 2022-05-02T09:38:50.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-05-02T09:38:50.497 INFO:tasks.ceph.osd.0:Started 2022-05-02T09:38:50.497 INFO:tasks.ceph.osd.1:Restarting daemon 2022-05-02T09:38:50.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-05-02T09:38:50.502 INFO:tasks.ceph.osd.1:Started 2022-05-02T09:38:50.502 INFO:tasks.ceph.osd.2:Restarting daemon 2022-05-02T09:38:50.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-05-02T09:38:50.509 INFO:tasks.ceph.osd.2:Started 2022-05-02T09:38:50.509 INFO:tasks.ceph.osd.3:Restarting daemon 2022-05-02T09:38:50.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-05-02T09:38:50.516 INFO:tasks.ceph.osd.3:Started 2022-05-02T09:38:50.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:38:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.835+0000 7f490b59e700 1 Processor -- start 2022-05-02T09:38:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.835+0000 7f490b59e700 1 -- start start 2022-05-02T09:38:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.836+0000 7f490b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.836+0000 7f490b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f490c065300 0x7f490c065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.836+0000 7f490b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c05be40 con 0x7f490c0a8310 2022-05-02T09:38:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.836+0000 7f490b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c1316e0 con 0x7f490c065300 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.836+0000 7f490b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c064e00 con 0x7f490c05ba60 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50110/0 (socket says 172.21.15.50:50110) 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 -- 172.21.15.50:0/1845082669 learned_addr learned my addr 172.21.15.50:0/1845082669 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f4909d9b700 1 --2- 172.21.15.50:0/1845082669 >> v2:172.21.15.50:3300/0 conn(0x7f490c065300 0x7f490c065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 -- 172.21.15.50:0/1845082669 >> v2:172.21.15.50:3300/0 conn(0x7f490c065300 msgr2=0x7f490c065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 --2- 172.21.15.50:0/1845082669 >> v2:172.21.15.50:3300/0 conn(0x7f490c065300 0x7f490c065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 -- 172.21.15.50:0/1845082669 >> v1:172.21.15.50:6789/0 conn(0x7f490c0a8310 legacy=0x7f490c1339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.837+0000 7f490a59c700 1 -- 172.21.15.50:0/1845082669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0a7db0 con 0x7f490c05ba60 2022-05-02T09:38:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490a59c700 1 --2- 172.21.15.50:0/1845082669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f48fc002f70 tx=0x7f48fc006eb0).ready entity=mon.1 client_cookie=30dcf020aebec050 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490959a700 1 -- 172.21.15.50:0/1845082669 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48fc00d570 con 0x7f490c05ba60 2022-05-02T09:38:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490959a700 1 -- 172.21.15.50:0/1845082669 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc000e90 con 0x7f490c05ba60 2022-05-02T09:38:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490959a700 1 -- 172.21.15.50:0/1845082669 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48fc00d900 con 0x7f490c05ba60 2022-05-02T09:38:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490b59e700 1 -- 172.21.15.50:0/1845082669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 msgr2=0x7f490c0a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.838+0000 7f490b59e700 1 --2- 172.21.15.50:0/1845082669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f48fc002f70 tx=0x7f48fc006eb0).stop 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 -- 172.21.15.50:0/1845082669 shutdown_connections 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 --2- 172.21.15.50:0/1845082669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c05ba60 0x7f490c0a9690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 --2- 172.21.15.50:0/1845082669 >> v2:172.21.15.50:3300/0 conn(0x7f490c065300 0x7f490c065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 -- 172.21.15.50:0/1845082669 >> 172.21.15.50:0/1845082669 conn(0x7f490c05c9b0 msgr2=0x7f490c05cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 -- 172.21.15.50:0/1845082669 shutdown_connections 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.839+0000 7f490b59e700 1 -- 172.21.15.50:0/1845082669 wait complete. 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.840+0000 7f490b59e700 1 Processor -- start 2022-05-02T09:38:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.840+0000 7f490b59e700 1 -- start start 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 0x7f490c09d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f490c0a8310 0x7f490c131840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0a6940 con 0x7f490c05ba60 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c133fe0 con 0x7f490c065300 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490b59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f490c134280 con 0x7f490c0a8310 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f4909d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 0x7f490c09d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.841+0000 7f490a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35522/0 (socket says 172.21.15.50:35522) 2022-05-02T09:38:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f490a59c700 1 -- 172.21.15.50:0/1073231215 learned_addr learned my addr 172.21.15.50:0/1073231215 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f490ad9d700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f490c0a8310 0x7f490c131840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 -- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f490c0a8310 msgr2=0x7f490c131840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f490c0a8310 0x7f490c131840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 -- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 msgr2=0x7f490c132d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 -- 172.21.15.50:0/1073231215 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc00b1e0 con 0x7f490c065300 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f490a59c700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.842+0000 7f4909d9b700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 0x7f490c09d1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f490000c000 tx=0x7f4900006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.843+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4900011750 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.843+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000118b0 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.843+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4900011c10 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.843+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c133430 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.843+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c09d6d0 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.844+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 2) v1 ==== 20790+0+0 (secure 0 0 0) 0x7f4900011d70 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.844+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1557+0+0 (secure 0 0 0) 0x7f4900029fe0 con 0x7f490c065300 2022-05-02T09:38:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.844+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c1336f0 con 0x7f490c065300 2022-05-02T09:38:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.847+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f490c1336f0 con 0x7f490c065300 2022-05-02T09:38:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.921+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f490c1336f0 con 0x7f490c065300 2022-05-02T09:38:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.921+0000 7f48fb7fe700 1 -- 172.21.15.50:0/1073231215 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+5317 (secure 0 0 0) 0x7f490c1336f0 con 0x7f490c065300 2022-05-02T09:38:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:38:50.926 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:38:50.461903+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"6","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:38:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 msgr2=0x7f490c09d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 0x7f490c09d1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f490000c000 tx=0x7f4900006df0).stop 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 shutdown_connections 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f490c0a8310 0x7f490c131840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f490c05ba60 0x7f490c132d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 --2- 172.21.15.50:0/1073231215 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f490c065300 0x7f490c09d1e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 >> 172.21.15.50:0/1073231215 conn(0x7f490c05c9b0 msgr2=0x7f490c061eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.923+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 shutdown_connections 2022-05-02T09:38:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:50.924+0000 7f490b59e700 1 -- 172.21.15.50:0/1073231215 wait complete. 2022-05-02T09:38:50.951 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '6', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {}}] 2022-05-02T09:38:50.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-05-02T09:38:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.158+0000 7fbbb159d700 1 Processor -- start 2022-05-02T09:38:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.158+0000 7fbbb159d700 1 -- start start 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb159d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139720 0x7fbbac05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb159d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbac05d7d0 0x7fbbac1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb159d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac05d360 con 0x7fbbac139b00 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb159d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac139010 con 0x7fbbac05d7d0 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb159d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1392d0 con 0x7fbbac139720 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbb0d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbac05d7d0 0x7fbbac1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.159+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139720 0x7fbbac05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbac05d7d0 0x7fbbac1402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35524/0 (socket says 172.21.15.50:35524) 2022-05-02T09:38:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 -- 172.21.15.50:0/1308124810 learned_addr learned my addr 172.21.15.50:0/1308124810 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbab7fe700 1 --1- 172.21.15.50:0/1308124810 >> v1:172.21.15.50:6789/0 conn(0x7fbbac139b00 0x7fbbac05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52108/0 (socket says 172.21.15.50:52108) 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 -- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139720 msgr2=0x7fbbac05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 --2- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139720 0x7fbbac05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 -- 172.21.15.50:0/1308124810 >> v1:172.21.15.50:6789/0 conn(0x7fbbac139b00 legacy=0x7fbbac05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 -- 172.21.15.50:0/1308124810 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0a7c50 con 0x7fbbac05d7d0 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.160+0000 7fbbb0d9c700 1 --2- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac1402a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbba40032f0 tx=0x7fbba4009290).ready entity=mon.0 client_cookie=db408bc8e833b47d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbaaffd700 1 -- 172.21.15.50:0/1308124810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba400b8a0 con 0x7fbbac05d7d0 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbaaffd700 1 -- 172.21.15.50:0/1308124810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400ba00 con 0x7fbbac05d7d0 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbaaffd700 1 -- 172.21.15.50:0/1308124810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba400bb70 con 0x7fbbac05d7d0 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 -- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 msgr2=0x7fbbac1402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 --2- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac1402a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbba40032f0 tx=0x7fbba4009290).stop 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 -- 172.21.15.50:0/1308124810 shutdown_connections 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 --2- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac1402a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 --2- 172.21.15.50:0/1308124810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139720 0x7fbbac05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 -- 172.21.15.50:0/1308124810 >> 172.21.15.50:0/1308124810 conn(0x7fbbac0669d0 msgr2=0x7fbbac0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 -- 172.21.15.50:0/1308124810 shutdown_connections 2022-05-02T09:38:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.161+0000 7fbbb159d700 1 -- 172.21.15.50:0/1308124810 wait complete. 2022-05-02T09:38:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.163+0000 7fbbb159d700 1 Processor -- start 2022-05-02T09:38:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.163+0000 7fbbb159d700 1 -- start start 2022-05-02T09:38:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.163+0000 7fbbb159d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.163+0000 7fbbb159d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbbac139720 0x7fbbac148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.163+0000 7fbbb159d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139b00 0x7fbbac148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbb159d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0a1490 con 0x7fbbac05d7d0 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbb159d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0a0630 con 0x7fbbac139b00 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbb159d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0a1960 con 0x7fbbac139720 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbb0d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139b00 0x7fbbac148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35526/0 (socket says 172.21.15.50:35526) 2022-05-02T09:38:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 -- 172.21.15.50:0/3668970308 learned_addr learned my addr 172.21.15.50:0/3668970308 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbab7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbbac139720 0x7fbbac148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 -- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbbac139720 msgr2=0x7fbbac148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbbac139720 0x7fbbac148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 -- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139b00 msgr2=0x7fbbac148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139b00 0x7fbbac148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.164+0000 7fbbabfff700 1 -- 172.21.15.50:0/3668970308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009530 con 0x7fbbac05d7d0 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbbabfff700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbb9c00c000 tx=0x7fbb9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c011750 con 0x7fbbac05d7d0 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0118b0 con 0x7fbbac05d7d0 2022-05-02T09:38:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac0a63d0 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c011c10 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.165+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac132b30 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.166+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 2) v1 ==== 20790+0+0 (secure 0 0 0) 0x7fbb9c011d70 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.166+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1557+0+0 (secure 0 0 0) 0x7fbb9c029fe0 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.166+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac057990 con 0x7fbbac05d7d0 2022-05-02T09:38:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.169+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fbb9c01a360 con 0x7fbbac05d7d0 2022-05-02T09:38:51.242 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:38:51.239+0000 7fdf0b6a9f00 -1 Falling back to public interface 2022-05-02T09:38:51.248 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:38:51.245+0000 7f8412612f00 -1 Falling back to public interface 2022-05-02T09:38:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.245+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbbac061b40 con 0x7fbbac05d7d0 2022-05-02T09:38:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.246+0000 7fbba97fa700 1 -- 172.21.15.50:0/3668970308 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v6) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb9c0102b0 con 0x7fbbac05d7d0 2022-05-02T09:38:51.249 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:38:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.247+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 msgr2=0x7fbbac0a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.247+0000 7fbbb159d700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbb9c00c000 tx=0x7fbb9c006df0).stop 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 shutdown_connections 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbac139b00 0x7fbbac148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbac05d7d0 0x7fbbac0a0ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 --2- 172.21.15.50:0/3668970308 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbbac139720 0x7fbbac148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 >> 172.21.15.50:0/3668970308 conn(0x7fbbac0669d0 msgr2=0x7fbbac1337d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 shutdown_connections 2022-05-02T09:38:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:51.248+0000 7fbbb159d700 1 -- 172.21.15.50:0/3668970308 wait complete. 2022-05-02T09:38:51.276 INFO:tasks.ceph:Waiting for OSDs to come up 2022-05-02T09:38:51.277 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:38:51.274+0000 7f504b081f00 -1 Falling back to public interface 2022-05-02T09:38:51.289 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:38:51.286+0000 7f99d5bbaf00 -1 Falling back to public interface 2022-05-02T09:38:51.679 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-05-02T09:38:51.907 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.904+0000 7f82441ff700 1 Processor -- start 2022-05-02T09:38:51.907 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.904+0000 7f82441ff700 1 -- start start 2022-05-02T09:38:51.908 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.905+0000 7f82441ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 0x7f823c0a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.909 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.905+0000 7f82441ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 0x7f823c135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.909 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.905+0000 7f82441ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c093d80 con 0x7f823c097e50 2022-05-02T09:38:51.909 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.905+0000 7f82441ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0a7490 con 0x7f823c0a7b60 2022-05-02T09:38:51.909 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.905+0000 7f82441ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0a7730 con 0x7f823c0a7f40 2022-05-02T09:38:51.910 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.906+0000 7f824179a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f823c097e50 0x7f823c135790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52110/0 (socket says 172.21.15.50:52110) 2022-05-02T09:38:51.910 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.906+0000 7f824179a700 1 -- 172.21.15.50:0/1905685132 learned_addr learned my addr 172.21.15.50:0/1905685132 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:38:51.910 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.906+0000 7f8241f9b700 1 --2- 172.21.15.50:0/1905685132 >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 0x7f823c0a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.910 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.906+0000 7f824279c700 1 --2- 172.21.15.50:0/1905685132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 0x7f823c135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.911 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f824279c700 1 -- 172.21.15.50:0/1905685132 >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 msgr2=0x7f823c0a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:51.911 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f824279c700 1 --2- 172.21.15.50:0/1905685132 >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 0x7f823c0a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f824279c700 1 -- 172.21.15.50:0/1905685132 >> v1:172.21.15.50:6789/0 conn(0x7f823c097e50 legacy=0x7f823c135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f824279c700 1 -- 172.21.15.50:0/1905685132 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c091e90 con 0x7f823c0a7f40 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f8240f99700 1 -- 172.21.15.50:0/1905685132 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600617543 0 0) 0x7f823c093d80 con 0x7f823c097e50 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f8241f9b700 1 --2- 172.21.15.50:0/1905685132 >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 0x7f823c0a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.907+0000 7f824279c700 1 --2- 172.21.15.50:0/1905685132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 0x7f823c135ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f82340032f0 tx=0x7f82340091d0).ready entity=mon.1 client_cookie=3c9a389c6f8d3433 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.908+0000 7f8240f99700 1 -- 172.21.15.50:0/1905685132 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823400b6c0 con 0x7f823c0a7f40 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.908+0000 7f8240f99700 1 -- 172.21.15.50:0/1905685132 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823400b820 con 0x7f823c0a7f40 2022-05-02T09:38:51.912 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.908+0000 7f8240f99700 1 -- 172.21.15.50:0/1905685132 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823400b990 con 0x7f823c0a7f40 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 -- 172.21.15.50:0/1905685132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 msgr2=0x7f823c135ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 --2- 172.21.15.50:0/1905685132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 0x7f823c135ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f82340032f0 tx=0x7f82340091d0).stop 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 -- 172.21.15.50:0/1905685132 shutdown_connections 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 --2- 172.21.15.50:0/1905685132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7f40 0x7f823c135ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 --2- 172.21.15.50:0/1905685132 >> v2:172.21.15.50:3300/0 conn(0x7f823c0a7b60 0x7f823c0a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.914 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 -- 172.21.15.50:0/1905685132 >> 172.21.15.50:0/1905685132 conn(0x7f823c0602d0 msgr2=0x7f823c05b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:51.915 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 -- 172.21.15.50:0/1905685132 shutdown_connections 2022-05-02T09:38:51.915 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.909+0000 7f82441ff700 1 -- 172.21.15.50:0/1905685132 wait complete. 2022-05-02T09:38:51.915 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.911+0000 7f82441ff700 1 Processor -- start 2022-05-02T09:38:51.915 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.911+0000 7f82441ff700 1 -- start start 2022-05-02T09:38:51.918 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 0x7f823c1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.918 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.918 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 0x7f823c063090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:51.918 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1365d0 con 0x7f823c097e50 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c064650 con 0x7f823c0a7b60 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f82441ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823c067160 con 0x7f823c0a7f40 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f824179a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f824179a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50128/0 (socket says 172.21.15.50:50128) 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f8241f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 0x7f823c1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.912+0000 7f824179a700 1 -- 172.21.15.50:0/1788992591 learned_addr learned my addr 172.21.15.50:0/1788992591 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f824279c700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 0x7f823c063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 -- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 msgr2=0x7f823c063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 0x7f823c063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.919 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 -- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 msgr2=0x7f823c064f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 -- 172.21.15.50:0/1788992591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823800b120 con 0x7f823c097e50 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f824279c700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 0x7f823c063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f824179a700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.913+0000 7f8241f9b700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 0x7f823c1360e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f823800c000 tx=0x7f8238008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.914+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8238012600 con 0x7f823c097e50 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.914+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238012760 con 0x7f823c097e50 2022-05-02T09:38:51.920 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.914+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8234009470 con 0x7f823c097e50 2022-05-02T09:38:51.921 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.914+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8238012ac0 con 0x7f823c097e50 2022-05-02T09:38:51.921 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.914+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c127380 con 0x7f823c097e50 2022-05-02T09:38:51.921 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.916+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c0a8390 con 0x7f823c097e50 2022-05-02T09:38:51.921 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.916+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 41593+0+0 (secure 0 0 0) 0x7f8238012c20 con 0x7f823c097e50 2022-05-02T09:38:51.921 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.917+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1581+0+0 (secure 0 0 0) 0x7f8238049cf0 con 0x7f823c097e50 2022-05-02T09:38:51.924 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:51.921+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f82380330d0 con 0x7f823c097e50 2022-05-02T09:38:52.051 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.048+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f823c057990 con 0x7f823c097e50 2022-05-02T09:38:52.052 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.049+0000 7f822affd700 1 -- 172.21.15.50:0/1788992591 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+5338 (secure 0 0 0) 0x7f8238032cc0 con 0x7f823c097e50 2022-05-02T09:38:52.052 INFO:teuthology.misc.health.smithi050.stdout: 2022-05-02T09:38:52.052 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":7,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:38:51.463456+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"7","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:38:52.054 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 >> v1:172.21.15.50:6800/30011 conn(0x7f821c0388a0 legacy=0x7f821c03ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:52.054 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 msgr2=0x7f823c1360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 0x7f823c1360e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f823800c000 tx=0x7f8238008040).stop 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 shutdown_connections 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f823c0a7f40 0x7f823c063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823c097e50 0x7f823c1360e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 --2- 172.21.15.50:0/1788992591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f823c0a7b60 0x7f823c064f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 >> 172.21.15.50:0/1788992591 conn(0x7f823c0602d0 msgr2=0x7f823c05c020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 shutdown_connections 2022-05-02T09:38:52.055 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:52.051+0000 7f82441ff700 1 -- 172.21.15.50:0/1788992591 wait complete. 2022-05-02T09:38:52.073 DEBUG:teuthology.misc:0 of 4 OSDs are up 2022-05-02T09:38:52.611 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:38:52.607+0000 7fdf0b6a9f00 -1 osd.0 0 log_to_monitors {default=true} 2022-05-02T09:38:52.665 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:38:52.662+0000 7f504b081f00 -1 osd.1 0 log_to_monitors {default=true} 2022-05-02T09:38:52.683 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:38:52.680+0000 7f99d5bbaf00 -1 osd.3 0 log_to_monitors {default=true} 2022-05-02T09:38:52.872 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:38:52.869+0000 7f8412612f00 -1 osd.2 0 log_to_monitors {default=true} 2022-05-02T09:38:54.543 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:38:54.539+0000 7f502e3ee700 -1 osd.1 0 waiting for initial osdmap 2022-05-02T09:38:54.544 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:38:54.540+0000 7f99b8dee700 -1 osd.3 0 waiting for initial osdmap 2022-05-02T09:38:54.544 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:38:54.540+0000 7f83f57ee700 -1 osd.2 0 waiting for initial osdmap 2022-05-02T09:38:54.544 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:38:54.540+0000 7fdeee9ee700 -1 osd.0 0 waiting for initial osdmap 2022-05-02T09:38:54.551 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:38:54.548+0000 7f503b7fc700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:38:54.553 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:38:54.550+0000 7f99c61fc700 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:38:54.553 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:38:54.550+0000 7f8402bfc700 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:38:54.553 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:38:54.550+0000 7fdefbdfc700 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:38:58.479 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-05-02T09:38:58.667 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.664+0000 7fad593ff700 1 Processor -- start 2022-05-02T09:38:58.668 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.664+0000 7fad593ff700 1 -- start start 2022-05-02T09:38:58.671 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.671 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.671 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54060190 0x7fad54060620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad54060b10 con 0x7fad54139b10 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5405c870 con 0x7fad54060190 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.665+0000 7fad593ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad54139670 con 0x7fad54139ef0 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad52ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad52ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35538/0 (socket says 172.21.15.50:35538) 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad52ffd700 1 -- 172.21.15.50:0/397286383 learned_addr learned my addr 172.21.15.50:0/397286383 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49444/0 (socket says 172.21.15.50:49444) 2022-05-02T09:38:58.672 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad537fe700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54060190 0x7fad54060620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 -- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54060190 msgr2=0x7fad54060620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54060190 0x7fad54060620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 -- 172.21.15.50:0/397286383 >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 msgr2=0x7fad5405d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 --2- 172.21.15.50:0/397286383 >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad527fc700 1 -- 172.21.15.50:0/397286383 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54139910 con 0x7fad54139ef0 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.666+0000 7fad52ffd700 1 --2- 172.21.15.50:0/397286383 >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad527fc700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fad48002f70 tx=0x7fad48006df0).ready entity=mon.2 client_cookie=e129b6d4eea15005 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad51ffb700 1 -- 172.21.15.50:0/397286383 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad4800d4a0 con 0x7fad54139ef0 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad51ffb700 1 -- 172.21.15.50:0/397286383 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48000e90 con 0x7fad54139ef0 2022-05-02T09:38:58.673 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad51ffb700 1 -- 172.21.15.50:0/397286383 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad4800d7f0 con 0x7fad54139ef0 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad593ff700 1 -- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 msgr2=0x7fad5405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.667+0000 7fad593ff700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fad48002f70 tx=0x7fad48006df0).stop 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 -- 172.21.15.50:0/397286383 shutdown_connections 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54060190 0x7fad54060620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 --2- 172.21.15.50:0/397286383 >> v2:172.21.15.50:3300/0 conn(0x7fad54139b10 0x7fad5405d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 --2- 172.21.15.50:0/397286383 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54139ef0 0x7fad5405fca0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 -- 172.21.15.50:0/397286383 >> 172.21.15.50:0/397286383 conn(0x7fad54066bf0 msgr2=0x7fad540ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 -- 172.21.15.50:0/397286383 shutdown_connections 2022-05-02T09:38:58.674 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.668+0000 7fad593ff700 1 -- 172.21.15.50:0/397286383 wait complete. 2022-05-02T09:38:58.677 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.669+0000 7fad593ff700 1 Processor -- start 2022-05-02T09:38:58.677 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.669+0000 7fad593ff700 1 -- start start 2022-05-02T09:38:58.677 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 0x7fad54145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54139ef0 0x7fad54146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad540a57b0 con 0x7fad54139b10 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54146940 con 0x7fad54139ef0 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad593ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad540a62e0 con 0x7fad54060190 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad52ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad527fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 0x7fad54145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad52ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49446/0 (socket says 172.21.15.50:49446) 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.670+0000 7fad52ffd700 1 -- 172.21.15.50:0/4025159929 learned_addr learned my addr 172.21.15.50:0/4025159929 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:58.678 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad537fe700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54139ef0 0x7fad54146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 -- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54139ef0 msgr2=0x7fad54146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54139ef0 0x7fad54146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 -- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 msgr2=0x7fad54145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 0x7fad54145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 -- 172.21.15.50:0/4025159929 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4400b1e0 con 0x7fad54060190 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad527fc700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 0x7fad54145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.671+0000 7fad52ffd700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fad4400c000 tx=0x7fad44006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.672+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad44012600 con 0x7fad54060190 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.672+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44012760 con 0x7fad54060190 2022-05-02T09:38:58.679 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.672+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4800b180 con 0x7fad54060190 2022-05-02T09:38:58.680 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.672+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad44012ac0 con 0x7fad54060190 2022-05-02T09:38:58.680 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.672+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad540a5a20 con 0x7fad54060190 2022-05-02T09:38:58.680 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.673+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fad44012c20 con 0x7fad54060190 2022-05-02T09:38:58.680 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.673+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad540a8a60 con 0x7fad54060190 2022-05-02T09:38:58.680 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.674+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2469+0+0 (secure 0 0 0) 0x7fad4404a1e0 con 0x7fad54060190 2022-05-02T09:38:58.681 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.678+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fad44033180 con 0x7fad54060190 2022-05-02T09:38:58.806 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.803+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad540a5a20 con 0x7fad54060190 2022-05-02T09:38:58.807 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.804+0000 7fad43fff700 1 -- 172.21.15.50:0/4025159929 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6242 (secure 0 0 0) 0x7fad540a5a20 con 0x7fad54060190 2022-05-02T09:38:58.807 INFO:teuthology.misc.health.smithi050.stdout: 2022-05-02T09:38:58.807 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":12,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:38:57.560644+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:38:58.809 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 >> v1:172.21.15.50:6800/30011 conn(0x7fad30038940 legacy=0x7fad3003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:58.809 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 msgr2=0x7fad540a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:58.809 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fad4400c000 tx=0x7fad44006eb0).stop 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 shutdown_connections 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fad54060190 0x7fad540a52c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad54139ef0 0x7fad54146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 --2- 172.21.15.50:0/4025159929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad54139b10 0x7fad54145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.805+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 >> 172.21.15.50:0/4025159929 conn(0x7fad54066bf0 msgr2=0x7fad540ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.806+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 shutdown_connections 2022-05-02T09:38:58.810 INFO:teuthology.misc.health.smithi050.stderr:2022-05-02T09:38:58.806+0000 7fad593ff700 1 -- 172.21.15.50:0/4025159929 wait complete. 2022-05-02T09:38:58.828 DEBUG:teuthology.misc:4 of 4 OSDs are up 2022-05-02T09:38:58.828 INFO:tasks.ceph:Creating RBD pool 2022-05-02T09:38:58.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2022-05-02T09:38:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.020+0000 7fba5ab9d700 1 Processor -- start 2022-05-02T09:38:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.020+0000 7fba5ab9d700 1 -- start start 2022-05-02T09:38:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.021+0000 7fba5ab9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 0x7fba5405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.021+0000 7fba5ab9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.021+0000 7fba5ab9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5405d360 con 0x7fba54139b00 2022-05-02T09:38:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.021+0000 7fba5ab9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54139010 con 0x7fba54139720 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.021+0000 7fba5ab9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba541392d0 con 0x7fba5405d7d0 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba59b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 0x7fba5405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49448/0 (socket says 172.21.15.50:49448) 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 -- 172.21.15.50:0/773031818 learned_addr learned my addr 172.21.15.50:0/773031818 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba59b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 0x7fba5405b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35542/0 (socket says 172.21.15.50:35542) 2022-05-02T09:38:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 -- 172.21.15.50:0/773031818 >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 msgr2=0x7fba5405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 --2- 172.21.15.50:0/773031818 >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 0x7fba5405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 -- 172.21.15.50:0/773031818 >> v1:172.21.15.50:6789/0 conn(0x7fba54139b00 legacy=0x7fba5405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.022+0000 7fba5a39c700 1 -- 172.21.15.50:0/773031818 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540a7c50 con 0x7fba5405d7d0 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5a39c700 1 --2- 172.21.15.50:0/773031818 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fba4c0032f0 tx=0x7fba4c009290).ready entity=mon.2 client_cookie=37ebd79ad9816077 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba58b99700 1 -- 172.21.15.50:0/773031818 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00b8a0 con 0x7fba5405d7d0 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba58b99700 1 -- 172.21.15.50:0/773031818 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00ba00 con 0x7fba5405d7d0 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba58b99700 1 -- 172.21.15.50:0/773031818 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00bb70 con 0x7fba5405d7d0 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 -- 172.21.15.50:0/773031818 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 msgr2=0x7fba541402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/773031818 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fba4c0032f0 tx=0x7fba4c009290).stop 2022-05-02T09:38:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 -- 172.21.15.50:0/773031818 shutdown_connections 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/773031818 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba5405d7d0 0x7fba541402a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/773031818 >> v2:172.21.15.50:3300/0 conn(0x7fba54139720 0x7fba5405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.023+0000 7fba5ab9d700 1 -- 172.21.15.50:0/773031818 >> 172.21.15.50:0/773031818 conn(0x7fba540669d0 msgr2=0x7fba540a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.024+0000 7fba5ab9d700 1 -- 172.21.15.50:0/773031818 shutdown_connections 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.024+0000 7fba5ab9d700 1 -- 172.21.15.50:0/773031818 wait complete. 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.025+0000 7fba5ab9d700 1 Processor -- start 2022-05-02T09:38:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.025+0000 7fba5ab9d700 1 -- start start 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 0x7fba540a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 0x7fba5412bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba541332f0 con 0x7fba5405d7d0 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541325e0 con 0x7fba54139720 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5ab9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba54149740 con 0x7fba54139b00 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5939a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5a39c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 0x7fba5412bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba59b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 0x7fba540a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5939a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50138/0 (socket says 172.21.15.50:50138) 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5939a700 1 -- 172.21.15.50:0/3381856289 learned_addr learned my addr 172.21.15.50:0/3381856289 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.026+0000 7fba5a39c700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 0x7fba5412bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49452/0 (socket says 172.21.15.50:49452) 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 -- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 msgr2=0x7fba5412bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 0x7fba5412bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 -- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 msgr2=0x7fba540a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 0x7fba540a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 -- 172.21.15.50:0/3381856289 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c009530 con 0x7fba54139720 2022-05-02T09:38:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba59b9b700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 0x7fba540a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5939a700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fba540a9b00 tx=0x7fba44007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba44012400 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44012560 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba440128c0 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba540a1c00 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.027+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54130450 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.029+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fba44019030 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.029+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540a2b10 con 0x7fba54139720 2022-05-02T09:38:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.029+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2469+0+0 (secure 0 0 0) 0x7fba44049320 con 0x7fba54139720 2022-05-02T09:38:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.034+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fba4402e800 con 0x7fba54139720 2022-05-02T09:38:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.159+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fba54148b70 con 0x7fba54139720 2022-05-02T09:38:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.574+0000 7fba42ffd700 1 -- 172.21.15.50:0/3381856289 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7fba44031e20 con 0x7fba54139720 2022-05-02T09:38:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.577+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 >> v1:172.21.15.50:6800/30011 conn(0x7fba34038a60 legacy=0x7fba3403af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.577+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 msgr2=0x7fba54148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.577+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fba540a9b00 tx=0x7fba44007c50).stop 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 shutdown_connections 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba54139b00 0x7fba5412bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba5405d7d0 0x7fba540a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 --2- 172.21.15.50:0/3381856289 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba54139720 0x7fba54148d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 >> 172.21.15.50:0/3381856289 conn(0x7fba540669d0 msgr2=0x7fba5406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 shutdown_connections 2022-05-02T09:38:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.578+0000 7fba5ab9d700 1 -- 172.21.15.50:0/3381856289 wait complete. 2022-05-02T09:38:59.584 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2022-05-02T09:38:59.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-05-02T09:38:59.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.802+0000 7f3cd619d700 1 Processor -- start 2022-05-02T09:38:59.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.802+0000 7f3cd619d700 1 -- start start 2022-05-02T09:38:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.803+0000 7f3cd619d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd0136620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.803+0000 7f3cd619d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cd0136b10 0x7f3cd005ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.803+0000 7f3cd619d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd005c290 con 0x7f3cd005cf60 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.803+0000 7f3cd619d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00a6ab0 con 0x7f3cd0136b10 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.803+0000 7f3cd619d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00a6d50 con 0x7f3cd0136240 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cd0136b10 0x7f3cd005ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd519b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd0136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cd0136b10 0x7f3cd005ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35548/0 (socket says 172.21.15.50:35548) 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 -- 172.21.15.50:0/4258638180 learned_addr learned my addr 172.21.15.50:0/4258638180 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd519b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd0136620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49454/0 (socket says 172.21.15.50:49454) 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 -- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 msgr2=0x7f3cd0136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 --2- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd0136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 -- 172.21.15.50:0/4258638180 >> v1:172.21.15.50:6789/0 conn(0x7f3cd005cf60 legacy=0x7f3cd0139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 -- 172.21.15.50:0/4258638180 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0060710 con 0x7f3cd0136b10 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.804+0000 7f3cd499a700 1 --2- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd005ca70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3cc0002f70 tx=0x7f3cc0006eb0).ready entity=mon.0 client_cookie=2b3362f3487da2da server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cbffff700 1 -- 172.21.15.50:0/4258638180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc000d570 con 0x7f3cd0136b10 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cbffff700 1 -- 172.21.15.50:0/4258638180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0000e90 con 0x7f3cd0136b10 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cbffff700 1 -- 172.21.15.50:0/4258638180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc000d900 con 0x7f3cd0136b10 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 -- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 msgr2=0x7f3cd005ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 --2- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd005ca70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3cc0002f70 tx=0x7f3cc0006eb0).stop 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 -- 172.21.15.50:0/4258638180 shutdown_connections 2022-05-02T09:38:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 --2- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd0136620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 --2- 172.21.15.50:0/4258638180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd005ca70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.805+0000 7f3cd619d700 1 -- 172.21.15.50:0/4258638180 >> 172.21.15.50:0/4258638180 conn(0x7f3cd0066a80 msgr2=0x7f3cd00ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.806+0000 7f3cd619d700 1 -- 172.21.15.50:0/4258638180 shutdown_connections 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.806+0000 7f3cd619d700 1 -- 172.21.15.50:0/4258638180 wait complete. 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.807+0000 7f3cd619d700 1 Processor -- start 2022-05-02T09:38:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.807+0000 7f3cd619d700 1 -- start start 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.808+0000 7f3cd619d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 0x7f3cd00a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd619d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd619d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd00a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd619d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00a3600 con 0x7f3cd0136b10 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd619d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00a4b00 con 0x7f3cd005cf60 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd619d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd013c440 con 0x7f3cd0136240 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd499a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd519b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 0x7f3cd00a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd519b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 0x7f3cd00a3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50140/0 (socket says 172.21.15.50:50140) 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd519b700 1 -- 172.21.15.50:0/1764657447 learned_addr learned my addr 172.21.15.50:0/1764657447 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd499a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49456/0 (socket says 172.21.15.50:49456) 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd599c700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd00a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd499a700 1 -- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 msgr2=0x7f3cd00a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.809+0000 7f3cd499a700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 0x7f3cd00a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd499a700 1 -- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 msgr2=0x7f3cd00a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd499a700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd00a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd499a700 1 -- 172.21.15.50:0/1764657447 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc000b1e0 con 0x7f3cd0136240 2022-05-02T09:38:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd599c700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd00a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd499a700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3cc0002f70 tx=0x7f3cc0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc0011610 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0011770 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd0134be0 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc0011ad0 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.810+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00a2eb0 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.811+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f3cc0025030 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.812+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2811+0+0 (secure 0 0 0) 0x7f3cc004b100 con 0x7f3cd0136240 2022-05-02T09:38:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.812+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd00a87b0 con 0x7f3cd0136240 2022-05-02T09:38:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.816+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3cc0023030 con 0x7f3cd0136240 2022-05-02T09:38:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:38:59.941+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3cd0057990 con 0x7f3cd0136240 2022-05-02T09:39:00.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.582+0000 7f3cbe7fc700 1 -- 172.21.15.50:0/1764657447 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3cc00206d0 con 0x7f3cd0136240 2022-05-02T09:39:00.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.587+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 >> v1:172.21.15.50:6800/30011 conn(0x7f3cb00389d0 legacy=0x7f3cb003ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.587+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 msgr2=0x7f3cd00a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.587+0000 7f3cd619d700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3cc0002f70 tx=0x7f3cc0015000).stop 2022-05-02T09:39:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.588+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 shutdown_connections 2022-05-02T09:39:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.588+0000 7f3cd619d700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd0136b10 0x7f3cd00a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.588+0000 7f3cd619d700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cd005cf60 0x7f3cd00a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.588+0000 7f3cd619d700 1 --2- 172.21.15.50:0/1764657447 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3cd0136240 0x7f3cd00a17b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.588+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 >> 172.21.15.50:0/1764657447 conn(0x7f3cd0066a80 msgr2=0x7f3cd00a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:00.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.590+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 shutdown_connections 2022-05-02T09:39:00.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.590+0000 7f3cd619d700 1 -- 172.21.15.50:0/1764657447 wait complete. 2022-05-02T09:39:00.594 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2022-05-02T09:39:00.618 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-05-02T09:39:00.618 INFO:tasks.ceph.mds.a:Restarting daemon 2022-05-02T09:39:00.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-05-02T09:39:00.623 INFO:tasks.ceph.mds.a:Started 2022-05-02T09:39:00.623 INFO:tasks.ceph.mds.b:Restarting daemon 2022-05-02T09:39:00.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-05-02T09:39:00.630 INFO:tasks.ceph.mds.b:Started 2022-05-02T09:39:00.630 INFO:tasks.ceph.mds.c:Restarting daemon 2022-05-02T09:39:00.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-05-02T09:39:00.635 INFO:tasks.ceph.mds.c:Started 2022-05-02T09:39:00.635 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-05-02T09:39:00.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:00.817 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2022-05-02T09:39:00.818 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2022-05-02T09:39:00.824 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2022-05-02T09:39:00.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.868+0000 7f4e9f59e700 1 Processor -- start 2022-05-02T09:39:00.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.868+0000 7f4e9f59e700 1 -- start start 2022-05-02T09:39:00.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 0x7f4ea01327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:00.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ea0095430 0x7f4ea01330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:00.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea00a7270 con 0x7f4ea0136140 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea0094760 con 0x7f4ea0095430 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0135ea0 con 0x7f4ea00a6e90 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ea0095430 0x7f4ea01330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 0x7f4ea01327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.869+0000 7f4e9ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ea0136140 0x7f4ea01365a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52136/0 (socket says 172.21.15.50:52136) 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9ed9d700 1 -- 172.21.15.50:0/399826518 learned_addr learned my addr 172.21.15.50:0/399826518 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:00.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9dd9b700 1 -- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 msgr2=0x7f4ea01327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9dd9b700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 0x7f4ea01327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9dd9b700 1 -- 172.21.15.50:0/399826518 >> v1:172.21.15.50:6789/0 conn(0x7f4ea0136140 legacy=0x7f4ea01365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9dd9b700 1 -- 172.21.15.50:0/399826518 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea01335a0 con 0x7f4ea0095430 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9e59c700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 0x7f4ea01327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9d59a700 1 -- 172.21.15.50:0/399826518 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738473722 0 0) 0x7f4ea00a7270 con 0x7f4ea0136140 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.870+0000 7f4e9dd9b700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea0095430 0x7f4ea01330b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4e94002f70 tx=0x7f4e94006df0).ready entity=mon.0 client_cookie=d549671236f9efd server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9d59a700 1 -- 172.21.15.50:0/399826518 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9400d570 con 0x7f4ea0095430 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9d59a700 1 -- 172.21.15.50:0/399826518 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e94000e90 con 0x7f4ea0095430 2022-05-02T09:39:00.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9d59a700 1 -- 172.21.15.50:0/399826518 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9400d8c0 con 0x7f4ea0095430 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 -- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea0095430 msgr2=0x7f4ea01330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea0095430 0x7f4ea01330b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4e94002f70 tx=0x7f4e94006df0).stop 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 -- 172.21.15.50:0/399826518 shutdown_connections 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea00a6e90 0x7f4ea01327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/399826518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea0095430 0x7f4ea01330b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 -- 172.21.15.50:0/399826518 >> 172.21.15.50:0/399826518 conn(0x7f4ea005b8a0 msgr2=0x7f4ea005bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 -- 172.21.15.50:0/399826518 shutdown_connections 2022-05-02T09:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.871+0000 7f4e9f59e700 1 -- 172.21.15.50:0/399826518 wait complete. 2022-05-02T09:39:00.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.873+0000 7f4e9f59e700 1 Processor -- start 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.873+0000 7f4e9f59e700 1 -- start start 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea00a6e90 0x7f4ea0067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea0136140 0x7f4ea0145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009d060 con 0x7f4ea00a6e90 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009bc80 con 0x7f4ea0136140 2022-05-02T09:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9f59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009bf40 con 0x7f4ea0095430 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49464/0 (socket says 172.21.15.50:49464) 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 -- 172.21.15.50:0/809673807 learned_addr learned my addr 172.21.15.50:0/809673807 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9ed9d700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea0136140 0x7f4ea0145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9dd9b700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea00a6e90 0x7f4ea0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 -- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea0136140 msgr2=0x7f4ea0145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea0136140 0x7f4ea0145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 -- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea00a6e90 msgr2=0x7f4ea0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea00a6e90 0x7f4ea0067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.874+0000 7f4e9e59c700 1 -- 172.21.15.50:0/809673807 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9000b180 con 0x7f4ea0095430 2022-05-02T09:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e9e59c700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4e9000c000 tx=0x7f4e90006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9000c5f0 con 0x7f4ea0095430 2022-05-02T09:39:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000c750 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9000cab0 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9400b180 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.875+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea0067b50 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.876+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f4e9000cc10 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.876+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea0067f30 con 0x7f4ea0095430 2022-05-02T09:39:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.877+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f4e9004a5a0 con 0x7f4ea0095430 2022-05-02T09:39:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:00.880+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4e90033350 con 0x7f4ea0095430 2022-05-02T09:39:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.006+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ea006c070 con 0x7f4ea0095430 2022-05-02T09:39:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.007+0000 7f4e8f7fe700 1 -- 172.21.15.50:0/809673807 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7626 (secure 0 0 0) 0x7f4e90032f40 con 0x7f4ea0095430 2022-05-02T09:39:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:01.010 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:00.574241+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.008+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 >> v1:172.21.15.50:6800/30011 conn(0x7f4e7c0389d0 legacy=0x7f4e7c03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.008+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 msgr2=0x7f4ea0067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.008+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4e9000c000 tx=0x7f4e90006df0).stop 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.008+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 shutdown_connections 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4ea0095430 0x7f4ea0067170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ea0136140 0x7f4ea0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 --2- 172.21.15.50:0/809673807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea00a6e90 0x7f4ea0067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 >> 172.21.15.50:0/809673807 conn(0x7f4ea005b8a0 msgr2=0x7f4ea0132130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 shutdown_connections 2022-05-02T09:39:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.009+0000 7f4e9f59e700 1 -- 172.21.15.50:0/809673807 wait complete. 2022-05-02T09:39:01.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-05-02T09:39:01.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-05-02T09:39:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.242+0000 7f0f377ff700 1 Processor -- start 2022-05-02T09:39:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.242+0000 7f0f377ff700 1 -- start start 2022-05-02T09:39:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 0x7f0f300a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f3005cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f30139450 con 0x7f0f30139e80 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30139710 con 0x7f0f3005fca0 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.243+0000 7f0f377ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3005bd60 con 0x7f0f3005d8d0 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f34d9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f3005cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f3559b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 0x7f0f300a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50148/0 (socket says 172.21.15.50:50148) 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 -- 172.21.15.50:0/3247249391 learned_addr learned my addr 172.21.15.50:0/3247249391 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f34d9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f3005cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49466/0 (socket says 172.21.15.50:49466) 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f3559b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 0x7f0f300a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35564/0 (socket says 172.21.15.50:35564) 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 -- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 msgr2=0x7f0f3005cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 --2- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f3005cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 -- 172.21.15.50:0/3247249391 >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 msgr2=0x7f0f300a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 --2- 172.21.15.50:0/3247249391 >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 0x7f0f300a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.244+0000 7f0f35d9c700 1 -- 172.21.15.50:0/3247249391 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300a9970 con 0x7f0f3005fca0 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f35d9c700 1 --2- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0f280032f0 tx=0x7f0f28009290).ready entity=mon.1 client_cookie=1058db42b1e2bb24 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f1ffff700 1 -- 172.21.15.50:0/3247249391 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800b6c0 con 0x7f0f3005fca0 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f1ffff700 1 -- 172.21.15.50:0/3247249391 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2800b820 con 0x7f0f3005fca0 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f1ffff700 1 -- 172.21.15.50:0/3247249391 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800b990 con 0x7f0f3005fca0 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f377ff700 1 -- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 msgr2=0x7f0f30060130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.245+0000 7f0f377ff700 1 --2- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0f280032f0 tx=0x7f0f28009290).stop 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 -- 172.21.15.50:0/3247249391 shutdown_connections 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 --2- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f30060130 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 --2- 172.21.15.50:0/3247249391 >> v2:172.21.15.50:3300/0 conn(0x7f0f30139e80 0x7f0f300a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 --2- 172.21.15.50:0/3247249391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f3005cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 -- 172.21.15.50:0/3247249391 >> 172.21.15.50:0/3247249391 conn(0x7f0f30066b60 msgr2=0x7f0f300a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 -- 172.21.15.50:0/3247249391 shutdown_connections 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.246+0000 7f0f377ff700 1 -- 172.21.15.50:0/3247249391 wait complete. 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.247+0000 7f0f377ff700 1 Processor -- start 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.247+0000 7f0f377ff700 1 -- start start 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f300a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f30139e80 0x7f0f300a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300a4240 con 0x7f0f30139e80 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300a4520 con 0x7f0f3005fca0 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f377ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300a39d0 con 0x7f0f3005d8d0 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f34d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f3559b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f300a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f34d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50150/0 (socket says 172.21.15.50:50150) 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f34d9a700 1 -- 172.21.15.50:0/573198962 learned_addr learned my addr 172.21.15.50:0/573198962 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f3559b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f300a2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49468/0 (socket says 172.21.15.50:49468) 2022-05-02T09:39:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.248+0000 7f0f35d9c700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f30139e80 0x7f0f300a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 -- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 msgr2=0x7f0f300a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f300a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 -- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f30139e80 msgr2=0x7f0f300a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f30139e80 0x7f0f300a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 -- 172.21.15.50:0/573198962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28009530 con 0x7f0f3005fca0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f34d9a700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0f2000c000 tx=0x7f0f20006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f20010780 con 0x7f0f3005fca0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f200108e0 con 0x7f0f3005fca0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f300a3c70 con 0x7f0f3005fca0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.249+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f20010c40 con 0x7f0f3005fca0 2022-05-02T09:39:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.250+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f300a5630 con 0x7f0f3005fca0 2022-05-02T09:39:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.251+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0f2001c460 con 0x7f0f3005fca0 2022-05-02T09:39:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.251+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f300a5940 con 0x7f0f3005fca0 2022-05-02T09:39:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.251+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f0f2004a390 con 0x7f0f3005fca0 2022-05-02T09:39:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.255+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0f20033140 con 0x7f0f3005fca0 2022-05-02T09:39:01.384 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.380+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0f300a4660 con 0x7f0f3005fca0 2022-05-02T09:39:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.381+0000 7f0f1e7fc700 1 -- 172.21.15.50:0/573198962 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0f300a4660 con 0x7f0f3005fca0 2022-05-02T09:39:01.385 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:39:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.382+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 >> v1:172.21.15.50:6800/30011 conn(0x7f0f10038970 legacy=0x7f0f1003ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.382+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 msgr2=0x7f0f300a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.382+0000 7f0f377ff700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0f2000c000 tx=0x7f0f20006df0).stop 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 shutdown_connections 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0f3005d8d0 0x7f0f300a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f30139e80 0x7f0f300a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 --2- 172.21.15.50:0/573198962 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f3005fca0 0x7f0f300a0630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 >> 172.21.15.50:0/573198962 conn(0x7f0f30066b60 msgr2=0x7f0f30060080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 shutdown_connections 2022-05-02T09:39:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.383+0000 7f0f377ff700 1 -- 172.21.15.50:0/573198962 wait complete. 2022-05-02T09:39:01.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:39:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.619+0000 7f2b0359d700 1 Processor -- start 2022-05-02T09:39:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.619+0000 7f2b0359d700 1 -- start start 2022-05-02T09:39:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2afc136140 0x7f2afc1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0a7270 con 0x7f2afc136140 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc094760 con 0x7f2afc095430 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.620+0000 7f2b0359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc135ea0 con 0x7f2afc0a6e90 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b0259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b02d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2afc136140 0x7f2afc1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50152/0 (socket says 172.21.15.50:50152) 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b0259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49470/0 (socket says 172.21.15.50:49470) 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 -- 172.21.15.50:0/347250719 learned_addr learned my addr 172.21.15.50:0/347250719 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 -- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 msgr2=0x7f2afc1327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 -- 172.21.15.50:0/347250719 >> v2:172.21.15.50:3300/0 conn(0x7f2afc136140 msgr2=0x7f2afc1365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 --2- 172.21.15.50:0/347250719 >> v2:172.21.15.50:3300/0 conn(0x7f2afc136140 0x7f2afc1365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b01d9a700 1 -- 172.21.15.50:0/347250719 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc1335a0 con 0x7f2afc095430 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.621+0000 7f2b0259b700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b01d9a700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2aec002f70 tx=0x7f2aec006eb0).ready entity=mon.1 client_cookie=516a892d0cff081e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b01599700 1 -- 172.21.15.50:0/347250719 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aec00d570 con 0x7f2afc095430 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b01599700 1 -- 172.21.15.50:0/347250719 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec000e90 con 0x7f2afc095430 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b01599700 1 -- 172.21.15.50:0/347250719 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aec00d900 con 0x7f2afc095430 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 -- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 msgr2=0x7f2afc1330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2aec002f70 tx=0x7f2aec006eb0).stop 2022-05-02T09:39:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 -- 172.21.15.50:0/347250719 shutdown_connections 2022-05-02T09:39:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 --2- 172.21.15.50:0/347250719 >> v2:172.21.15.50:3300/0 conn(0x7f2afc136140 0x7f2afc1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc0a6e90 0x7f2afc1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 --2- 172.21.15.50:0/347250719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc095430 0x7f2afc1330b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.622+0000 7f2b0359d700 1 -- 172.21.15.50:0/347250719 >> 172.21.15.50:0/347250719 conn(0x7f2afc05b8a0 msgr2=0x7f2afc05bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.623+0000 7f2b0359d700 1 -- 172.21.15.50:0/347250719 shutdown_connections 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.623+0000 7f2b0359d700 1 -- 172.21.15.50:0/347250719 wait complete. 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.624+0000 7f2b0359d700 1 Processor -- start 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.624+0000 7f2b0359d700 1 -- start start 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 0x7f2afc134ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc136140 0x7f2afc134fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc098e00 con 0x7f2afc0a6e90 2022-05-02T09:39:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc141d90 con 0x7f2afc136140 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc142050 con 0x7f2afc095430 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0259b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49472/0 (socket says 172.21.15.50:49472) 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b0259b700 1 -- 172.21.15.50:0/264601536 learned_addr learned my addr 172.21.15.50:0/264601536 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b01d9a700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 0x7f2afc134ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.625+0000 7f2b02d9c700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc136140 0x7f2afc134fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 -- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc136140 msgr2=0x7f2afc134fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc136140 0x7f2afc134fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 -- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 msgr2=0x7f2afc134ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 0x7f2afc134ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 -- 172.21.15.50:0/264601536 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af800b180 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b01d9a700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 0x7f2afc134ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0259b700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2afc0618c0 tx=0x7f2af8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af800c7e0 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800c940 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af800cca0 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.626+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec00b1e0 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.627+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc098fa0 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.628+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc06c070 con 0x7f2afc095430 2022-05-02T09:39:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.628+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f2af801c460 con 0x7f2afc095430 2022-05-02T09:39:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.629+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f2af804a5c0 con 0x7f2afc095430 2022-05-02T09:39:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.632+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2af80333e0 con 0x7f2afc095430 2022-05-02T09:39:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.755+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2afc062080 con 0x7f2afc095430 2022-05-02T09:39:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.756+0000 7f2aeb7fe700 1 -- 172.21.15.50:0/264601536 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2af800ce00 con 0x7f2afc095430 2022-05-02T09:39:01.759 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:39:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.757+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 >> v1:172.21.15.50:6800/30011 conn(0x7f2adc038940 legacy=0x7f2adc03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.757+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 msgr2=0x7f2afc1413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.757+0000 7f2b0359d700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2afc0618c0 tx=0x7f2af8006df0).stop 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 shutdown_connections 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f2afc095430 0x7f2afc1413c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2afc136140 0x7f2afc134fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 --2- 172.21.15.50:0/264601536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2afc0a6e90 0x7f2afc134ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 >> 172.21.15.50:0/264601536 conn(0x7f2afc05b8a0 msgr2=0x7f2afc130f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 shutdown_connections 2022-05-02T09:39:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.759+0000 7f2b0359d700 1 -- 172.21.15.50:0/264601536 wait complete. 2022-05-02T09:39:01.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:01.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.987+0000 7f95ea99d700 1 Processor -- start 2022-05-02T09:39:01.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.987+0000 7f95ea99d700 1 -- start start 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 0x7f95e405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 0x7f95e41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e405d360 con 0x7f95e4139720 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e4139010 con 0x7f95e4139b00 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41392d0 con 0x7f95e405d7d0 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95e999b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95e4139720 0x7f95e405cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52138/0 (socket says 172.21.15.50:52138) 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95e999b700 1 -- 172.21.15.50:0/1511815980 learned_addr learned my addr 172.21.15.50:0/1511815980 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.988+0000 7f95ea19c700 1 --2- 172.21.15.50:0/1511815980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 0x7f95e41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95e919a700 1 --2- 172.21.15.50:0/1511815980 >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 0x7f95e405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95e8999700 1 -- 172.21.15.50:0/1511815980 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527800422 0 0) 0x7f95e405d360 con 0x7f95e4139720 2022-05-02T09:39:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95ea19c700 1 -- 172.21.15.50:0/1511815980 >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 msgr2=0x7f95e405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95ea19c700 1 --2- 172.21.15.50:0/1511815980 >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 0x7f95e405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95ea19c700 1 -- 172.21.15.50:0/1511815980 >> v1:172.21.15.50:6789/0 conn(0x7f95e4139720 legacy=0x7f95e405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95ea19c700 1 -- 172.21.15.50:0/1511815980 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40a7c50 con 0x7f95e405d7d0 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95e919a700 1 --2- 172.21.15.50:0/1511815980 >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 0x7f95e405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.989+0000 7f95ea19c700 1 --2- 172.21.15.50:0/1511815980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 0x7f95e41402a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f95dc0032f0 tx=0x7f95dc0091d0).ready entity=mon.2 client_cookie=85682dbddf8785a9 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95e8999700 1 -- 172.21.15.50:0/1511815980 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95dc00b6c0 con 0x7f95e405d7d0 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95e8999700 1 -- 172.21.15.50:0/1511815980 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc00b820 con 0x7f95e405d7d0 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95e8999700 1 -- 172.21.15.50:0/1511815980 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95dc00b990 con 0x7f95e405d7d0 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 -- 172.21.15.50:0/1511815980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 msgr2=0x7f95e41402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1511815980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 0x7f95e41402a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f95dc0032f0 tx=0x7f95dc0091d0).stop 2022-05-02T09:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 -- 172.21.15.50:0/1511815980 shutdown_connections 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1511815980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e405d7d0 0x7f95e41402a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1511815980 >> v2:172.21.15.50:3300/0 conn(0x7f95e4139b00 0x7f95e405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 -- 172.21.15.50:0/1511815980 >> 172.21.15.50:0/1511815980 conn(0x7f95e40669d0 msgr2=0x7f95e40a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.990+0000 7f95ea99d700 1 -- 172.21.15.50:0/1511815980 shutdown_connections 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.991+0000 7f95ea99d700 1 -- 172.21.15.50:0/1511815980 wait complete. 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.992+0000 7f95ea99d700 1 Processor -- start 2022-05-02T09:39:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.992+0000 7f95ea99d700 1 -- start start 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e4139b00 0x7f95e4148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40a0710 con 0x7f95e405d7d0 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4132d10 con 0x7f95e4139720 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4132fd0 con 0x7f95e4139b00 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e999b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e919a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e999b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35576/0 (socket says 172.21.15.50:35576) 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e999b700 1 -- 172.21.15.50:0/1958278728 learned_addr learned my addr 172.21.15.50:0/1958278728 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e919a700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50156/0 (socket says 172.21.15.50:50156) 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95ea19c700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e4139b00 0x7f95e4148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e919a700 1 -- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e4139b00 msgr2=0x7f95e4148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.993+0000 7f95e919a700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e4139b00 0x7f95e4148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95e919a700 1 -- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 msgr2=0x7f95e4132690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95e919a700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95e919a700 1 -- 172.21.15.50:0/1958278728 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d400b180 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95e999b700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95e919a700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f95d400c000 tx=0x7f95d4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d4010780 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d40108e0 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d4010c40 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc009470 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.994+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e40a1ed0 con 0x7f95e4139720 2022-05-02T09:39:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.996+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e40a2690 con 0x7f95e4139720 2022-05-02T09:39:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.996+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f95d401c460 con 0x7f95e4139720 2022-05-02T09:39:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:01.997+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f95d404a3b0 con 0x7f95e4139720 2022-05-02T09:39:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.000+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f95d4033270 con 0x7f95e4139720 2022-05-02T09:39:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.157+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95e40a21f0 con 0x7f95e4139720 2022-05-02T09:39:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.158+0000 7f95d2ffd700 1 -- 172.21.15.50:0/1958278728 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f95e40a21f0 con 0x7f95e4139720 2022-05-02T09:39:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:02.161 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-05-02T09:39:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.159+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 >> v1:172.21.15.50:6800/30011 conn(0x7f95c4038a90 legacy=0x7f95c403af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.159+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 msgr2=0x7f95e4148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.159+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f95d400c000 tx=0x7f95d4006df0).stop 2022-05-02T09:39:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 shutdown_connections 2022-05-02T09:39:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95e4139b00 0x7f95e4148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e405d7d0 0x7f95e4132690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 --2- 172.21.15.50:0/1958278728 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95e4139720 0x7f95e4148800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 >> 172.21.15.50:0/1958278728 conn(0x7f95e40669d0 msgr2=0x7f95e405cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 shutdown_connections 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:02.160+0000 7f95ea99d700 1 -- 172.21.15.50:0/1958278728 wait complete. 2022-05-02T09:39:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 1 2022-05-02T09:39:04.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:04.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.397+0000 7f3ffe7ff700 1 Processor -- start 2022-05-02T09:39:04.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.397+0000 7f3ffe7ff700 1 -- start start 2022-05-02T09:39:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.398+0000 7f3ffe7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffe7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffe7ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ff805fca0 0x7f3ff8060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffe7ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8139450 con 0x7f3ff805fca0 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffe7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8139710 con 0x7f3ff805d8d0 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffe7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff805bd60 con 0x7f3ff8139e80 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50158/0 (socket says 172.21.15.50:50158) 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49478/0 (socket says 172.21.15.50:49478) 2022-05-02T09:39:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ff77fe700 1 -- 172.21.15.50:0/362261803 learned_addr learned my addr 172.21.15.50:0/362261803 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:04.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.399+0000 7f3ffcd9c700 1 --2- 172.21.15.50:0/362261803 >> v2:172.21.15.50:3300/0 conn(0x7f3ff805fca0 0x7f3ff8060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 -- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 msgr2=0x7f3ff80a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:04.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 -- 172.21.15.50:0/362261803 >> v2:172.21.15.50:3300/0 conn(0x7f3ff805fca0 msgr2=0x7f3ff8060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 --2- 172.21.15.50:0/362261803 >> v2:172.21.15.50:3300/0 conn(0x7f3ff805fca0 0x7f3ff8060150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 -- 172.21.15.50:0/362261803 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80a9970 con 0x7f3ff805d8d0 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff7fff700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff77fe700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3fec002f70 tx=0x7f3fec006eb0).ready entity=mon.1 client_cookie=7203b478da7023 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff6ffd700 1 -- 172.21.15.50:0/362261803 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fec00d570 con 0x7f3ff805d8d0 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff6ffd700 1 -- 172.21.15.50:0/362261803 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec000e90 con 0x7f3ff805d8d0 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.400+0000 7f3ff6ffd700 1 -- 172.21.15.50:0/362261803 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fec00d900 con 0x7f3ff805d8d0 2022-05-02T09:39:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 msgr2=0x7f3ff805cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3fec002f70 tx=0x7f3fec006eb0).stop 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/362261803 shutdown_connections 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/362261803 >> v2:172.21.15.50:3300/0 conn(0x7f3ff805fca0 0x7f3ff8060150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff8139e80 0x7f3ff80a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/362261803 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805d8d0 0x7f3ff805cde0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/362261803 >> 172.21.15.50:0/362261803 conn(0x7f3ff8066b60 msgr2=0x7f3ff80a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/362261803 shutdown_connections 2022-05-02T09:39:04.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.401+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/362261803 wait complete. 2022-05-02T09:39:04.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.402+0000 7f3ffe7ff700 1 Processor -- start 2022-05-02T09:39:04.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.402+0000 7f3ffe7ff700 1 -- start start 2022-05-02T09:39:04.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 0x7f3ff812e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8139e80 0x7f3ff812e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80a48a0 con 0x7f3ff8139e80 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8130c50 con 0x7f3ff805fca0 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.403+0000 7f3ffe7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80a57a0 con 0x7f3ff805d8d0 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 0x7f3ff812e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49480/0 (socket says 172.21.15.50:49480) 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 -- 172.21.15.50:0/231826638 learned_addr learned my addr 172.21.15.50:0/231826638 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 0x7f3ff812e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50160/0 (socket says 172.21.15.50:50160) 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ffcd9c700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8139e80 0x7f3ff812e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 -- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 msgr2=0x7f3ff812e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 0x7f3ff812e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 -- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8139e80 msgr2=0x7f3ff812e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:04.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8139e80 0x7f3ff812e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.404+0000 7f3ff7fff700 1 -- 172.21.15.50:0/231826638 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe800b180 con 0x7f3ff805d8d0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ff7fff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3fe800c000 tx=0x7f3fe8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8010590 con 0x7f3ff805d8d0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe80106f0 con 0x7f3ff805d8d0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8010a50 con 0x7f3ff805d8d0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec00b1e0 con 0x7f3ff805d8d0 2022-05-02T09:39:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.405+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff8130970 con 0x7f3ff805d8d0 2022-05-02T09:39:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.406+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff80abf50 con 0x7f3ff805d8d0 2022-05-02T09:39:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.407+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f3fe8010bb0 con 0x7f3ff805d8d0 2022-05-02T09:39:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.407+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3fe804a430 con 0x7f3ff805d8d0 2022-05-02T09:39:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.411+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3fe802f710 con 0x7f3ff805d8d0 2022-05-02T09:39:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.571+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ff8057990 con 0x7f3ff805d8d0 2022-05-02T09:39:04.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.571+0000 7f3ff57fa700 1 -- 172.21.15.50:0/231826638 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f3fe8032ee0 con 0x7f3ff805d8d0 2022-05-02T09:39:04.613 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:04.613 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-05-02T09:39:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 >> v1:172.21.15.50:6800/30011 conn(0x7f3fd8038940 legacy=0x7f3fd803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 msgr2=0x7f3ff80a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3fe800c000 tx=0x7f3fe8006df0).stop 2022-05-02T09:39:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 shutdown_connections 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3ff805d8d0 0x7f3ff80a5180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8139e80 0x7f3ff812e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 --2- 172.21.15.50:0/231826638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ff805fca0 0x7f3ff812e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 >> 172.21.15.50:0/231826638 conn(0x7f3ff8066b60 msgr2=0x7f3ff80a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.573+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 shutdown_connections 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:04.574+0000 7f3ffe7ff700 1 -- 172.21.15.50:0/231826638 wait complete. 2022-05-02T09:39:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 1 2022-05-02T09:39:06.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.829+0000 7fd413dff700 1 Processor -- start 2022-05-02T09:39:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.829+0000 7fd413dff700 1 -- start start 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 0x7fd40c0998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137930 0x7fd40c133b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c099d90 con 0x7fd40c0994c0 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c094e60 con 0x7fd40c137930 2022-05-02T09:39:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.830+0000 7fd413dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c095100 con 0x7fd40c137530 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd411b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 0x7fd40c0998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41239c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137930 0x7fd40c133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd411b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 0x7fd40c0998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35582/0 (socket says 172.21.15.50:35582) 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd411b9b700 1 -- 172.21.15.50:0/562303721 learned_addr learned my addr 172.21.15.50:0/562303721 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49482/0 (socket says 172.21.15.50:49482) 2022-05-02T09:39:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 -- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137930 msgr2=0x7fd40c133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 --2- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137930 0x7fd40c133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 -- 172.21.15.50:0/562303721 >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 msgr2=0x7fd40c0998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 --2- 172.21.15.50:0/562303721 >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 0x7fd40c0998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.831+0000 7fd41139a700 1 -- 172.21.15.50:0/562303721 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c095920 con 0x7fd40c137530 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.832+0000 7fd41139a700 1 --2- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd3fc002f70 tx=0x7fd3fc006df0).ready entity=mon.2 client_cookie=bcd1ed2f01106b75 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.832+0000 7fd410b99700 1 -- 172.21.15.50:0/562303721 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3fc00d4a0 con 0x7fd40c137530 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.832+0000 7fd410b99700 1 -- 172.21.15.50:0/562303721 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc000e90 con 0x7fd40c137530 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.832+0000 7fd410b99700 1 -- 172.21.15.50:0/562303721 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3fc00d7f0 con 0x7fd40c137530 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 -- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 msgr2=0x7fd40c094490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 --2- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd3fc002f70 tx=0x7fd3fc006df0).stop 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 -- 172.21.15.50:0/562303721 shutdown_connections 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 --2- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137930 0x7fd40c133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 --2- 172.21.15.50:0/562303721 >> v2:172.21.15.50:3300/0 conn(0x7fd40c0994c0 0x7fd40c0998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 --2- 172.21.15.50:0/562303721 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137530 0x7fd40c094490 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 -- 172.21.15.50:0/562303721 >> 172.21.15.50:0/562303721 conn(0x7fd40c0a7e80 msgr2=0x7fd40c0a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 -- 172.21.15.50:0/562303721 shutdown_connections 2022-05-02T09:39:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.833+0000 7fd413dff700 1 -- 172.21.15.50:0/562303721 wait complete. 2022-05-02T09:39:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.835+0000 7fd413dff700 1 Processor -- start 2022-05-02T09:39:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.835+0000 7fd413dff700 1 -- start start 2022-05-02T09:39:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 0x7fd40c063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137930 0x7fd40c061db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c062d60 con 0x7fd40c0994c0 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0635f0 con 0x7fd40c137530 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.836+0000 7fd413dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c14cd80 con 0x7fd40c137930 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.837+0000 7fd41139a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.837+0000 7fd41139a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50164/0 (socket says 172.21.15.50:50164) 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.837+0000 7fd41139a700 1 -- 172.21.15.50:0/1072978322 learned_addr learned my addr 172.21.15.50:0/1072978322 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.837+0000 7fd411b9b700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 0x7fd40c063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.837+0000 7fd41239c700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137930 0x7fd40c061db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 -- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137930 msgr2=0x7fd40c061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137930 0x7fd40c061db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 -- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 msgr2=0x7fd40c063cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 0x7fd40c063cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 -- 172.21.15.50:0/1072978322 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc00b180 con 0x7fd40c137530 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd411b9b700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 0x7fd40c063cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd41139a700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd40c062ea0 tx=0x7fd3fc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.838+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3fc0139c0 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.839+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc013b20 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.839+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3fc013e80 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.839+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c134540 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.839+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c062460 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.840+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fd3fc025030 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.840+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c061bb0 con 0x7fd40c137530 2022-05-02T09:39:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.840+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fd3fc04aec0 con 0x7fd40c137530 2022-05-02T09:39:06.846 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:06.844+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd3fc01fb10 con 0x7fd40c137530 2022-05-02T09:39:07.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.000+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd40c057990 con 0x7fd40c137530 2022-05-02T09:39:07.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.000+0000 7fd3faffd700 1 -- 172.21.15.50:0/1072978322 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1378 (secure 0 0 0) 0x7fd3fc01f700 con 0x7fd40c137530 2022-05-02T09:39:07.003 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[]} 2022-05-02T09:39:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 >> v1:172.21.15.50:6800/30011 conn(0x7fd3ec0389c0 legacy=0x7fd3ec03ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 msgr2=0x7fd40c062870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd40c062ea0 tx=0x7fd3fc014000).stop 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 shutdown_connections 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd40c137930 0x7fd40c061db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd40c0994c0 0x7fd40c063cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 --2- 172.21.15.50:0/1072978322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd40c137530 0x7fd40c062870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 >> 172.21.15.50:0/1072978322 conn(0x7fd40c0a7e80 msgr2=0x7fd40c0a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 shutdown_connections 2022-05-02T09:39:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.002+0000 7fd413dff700 1 -- 172.21.15.50:0/1072978322 wait complete. 2022-05-02T09:39:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2022-05-02T09:39:07.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:07.234 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.231+0000 7f58b339d700 1 Processor -- start 2022-05-02T09:39:07.234 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.231+0000 7f58b339d700 1 -- start start 2022-05-02T09:39:07.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.232+0000 7f58b339d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac139720 0x7f58ac05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.232+0000 7f58b339d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.232+0000 7f58b339d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac139010 con 0x7f58ac05cc50 2022-05-02T09:39:07.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.232+0000 7f58b339d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1392d0 con 0x7f58ac139b00 2022-05-02T09:39:07.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.232+0000 7f58b339d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0a7c50 con 0x7f58ac139720 2022-05-02T09:39:07.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50166/0 (socket says 172.21.15.50:50166) 2022-05-02T09:39:07.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 -- 172.21.15.50:0/1656694597 learned_addr learned my addr 172.21.15.50:0/1656694597 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:07.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b239b700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac139720 0x7f58ac05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 -- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac139720 msgr2=0x7f58ac05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac139720 0x7f58ac05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 -- 172.21.15.50:0/1656694597 >> v1:172.21.15.50:6789/0 conn(0x7f58ac05cc50 legacy=0x7f58ac05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.233+0000 7f58b1b9a700 1 -- 172.21.15.50:0/1656694597 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0a95d0 con 0x7f58ac139b00 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b1b9a700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f589c002f70 tx=0x7f589c006eb0).ready entity=mon.1 client_cookie=5d006386950c4005 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b1399700 1 -- 172.21.15.50:0/1656694597 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589c00d570 con 0x7f58ac139b00 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b1399700 1 -- 172.21.15.50:0/1656694597 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c000e90 con 0x7f58ac139b00 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b1399700 1 -- 172.21.15.50:0/1656694597 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589c00d900 con 0x7f58ac139b00 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 -- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 msgr2=0x7f58ac05d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f589c002f70 tx=0x7f589c006eb0).stop 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 -- 172.21.15.50:0/1656694597 shutdown_connections 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac139720 0x7f58ac05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 --2- 172.21.15.50:0/1656694597 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139b00 0x7f58ac05d7d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.234+0000 7f58b339d700 1 -- 172.21.15.50:0/1656694597 >> 172.21.15.50:0/1656694597 conn(0x7f58ac0669d0 msgr2=0x7f58ac0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.235+0000 7f58b339d700 1 -- 172.21.15.50:0/1656694597 shutdown_connections 2022-05-02T09:39:07.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.235+0000 7f58b339d700 1 -- 172.21.15.50:0/1656694597 wait complete. 2022-05-02T09:39:07.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.236+0000 7f58b339d700 1 Processor -- start 2022-05-02T09:39:07.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.236+0000 7f58b339d700 1 -- start start 2022-05-02T09:39:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 0x7f58ac0a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac139b00 0x7f58ac148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0a1390 con 0x7f58ac139b00 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1320c0 con 0x7f58ac139720 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b339d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1364e0 con 0x7f58ac05cc50 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b1b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 0x7f58ac0a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b239b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b239b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49488/0 (socket says 172.21.15.50:49488) 2022-05-02T09:39:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b239b700 1 -- 172.21.15.50:0/453814407 learned_addr learned my addr 172.21.15.50:0/453814407 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.237+0000 7f58b2b9c700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac139b00 0x7f58ac148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 -- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 msgr2=0x7f58ac135ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 -- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac139b00 msgr2=0x7f58ac148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac139b00 0x7f58ac148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 -- 172.21.15.50:0/453814407 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c00b1e0 con 0x7f58ac139720 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b239b700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b1b9a700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 0x7f58ac0a09c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f589c002f70 tx=0x7f589c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589c021070 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c0116e0 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac0a2480 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589c011a40 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.238+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac0a0eb0 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.240+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f589c00f070 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.240+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac057990 con 0x7f58ac139720 2022-05-02T09:39:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.240+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f589c04af50 con 0x7f58ac139720 2022-05-02T09:39:07.246 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.243+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f589c0080e0 con 0x7f58ac139720 2022-05-02T09:39:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.369+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58ac0aba80 con 0x7f58ac139720 2022-05-02T09:39:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.370+0000 7f589b7fe700 1 -- 172.21.15.50:0/453814407 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+7613 (secure 0 0 0) 0x7f589c028360 con 0x7f58ac139720 2022-05-02T09:39:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:01.579359+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 >> v1:172.21.15.50:6800/30011 conn(0x7f588c038940 legacy=0x7f588c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 msgr2=0x7f58ac0a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 0x7f58ac0a09c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f589c002f70 tx=0x7f589c015000).stop 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 shutdown_connections 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f58ac05cc50 0x7f58ac135ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac139b00 0x7f58ac148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 --2- 172.21.15.50:0/453814407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58ac139720 0x7f58ac0a09c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 >> 172.21.15.50:0/453814407 conn(0x7f58ac0669d0 msgr2=0x7f58ac0aad90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 shutdown_connections 2022-05-02T09:39:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.372+0000 7f58b339d700 1 -- 172.21.15.50:0/453814407 wait complete. 2022-05-02T09:39:07.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-05-02T09:39:07.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-05-02T09:39:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.605+0000 7f06ba59d700 1 Processor -- start 2022-05-02T09:39:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.605+0000 7f06ba59d700 1 -- start start 2022-05-02T09:39:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 0x7f06b405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 0x7f06b405d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b405fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b4139010 con 0x7f06b4139720 2022-05-02T09:39:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b41392d0 con 0x7f06b4139b00 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.606+0000 7f06ba59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40a7c50 con 0x7f06b405cc50 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b9d9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b959b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 0x7f06b405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 0x7f06b405d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b9d9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b405fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49490/0 (socket says 172.21.15.50:49490) 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b9d9c700 1 -- 172.21.15.50:0/3899999101 learned_addr learned my addr 172.21.15.50:0/3899999101 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b959b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 0x7f06b405b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35588/0 (socket says 172.21.15.50:35588) 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 -- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 msgr2=0x7f06b405fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b405fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 -- 172.21.15.50:0/3899999101 >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 msgr2=0x7f06b405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/3899999101 >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 0x7f06b405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 -- 172.21.15.50:0/3899999101 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40a95d0 con 0x7f06b4139b00 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.607+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 0x7f06b405d7d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a4006df0).ready entity=mon.1 client_cookie=80131b5a4c8744ee server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06a3fff700 1 -- 172.21.15.50:0/3899999101 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06a400d4a0 con 0x7f06b4139b00 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06a3fff700 1 -- 172.21.15.50:0/3899999101 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4000e90 con 0x7f06b4139b00 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06a3fff700 1 -- 172.21.15.50:0/3899999101 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06a400d7f0 con 0x7f06b4139b00 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 -- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 msgr2=0x7f06b405d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 --2- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 0x7f06b405d7d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a4006df0).stop 2022-05-02T09:39:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 -- 172.21.15.50:0/3899999101 shutdown_connections 2022-05-02T09:39:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 --2- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b405fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 --2- 172.21.15.50:0/3899999101 >> v2:172.21.15.50:3300/0 conn(0x7f06b4139720 0x7f06b405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 --2- 172.21.15.50:0/3899999101 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139b00 0x7f06b405d7d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.608+0000 7f06ba59d700 1 -- 172.21.15.50:0/3899999101 >> 172.21.15.50:0/3899999101 conn(0x7f06b40669d0 msgr2=0x7f06b40a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.609+0000 7f06ba59d700 1 -- 172.21.15.50:0/3899999101 shutdown_connections 2022-05-02T09:39:07.615 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.609+0000 7f06ba59d700 1 -- 172.21.15.50:0/3899999101 wait complete. 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.610+0000 7f06ba59d700 1 Processor -- start 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.610+0000 7f06ba59d700 1 -- start start 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b41328f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 0x7f06b412c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40a2080 con 0x7f06b4139b00 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40a1ed0 con 0x7f06b4139720 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06ba59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4132f70 con 0x7f06b405cc50 2022-05-02T09:39:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b9d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 0x7f06b412c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b8d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b959b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b41328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b9d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 0x7f06b412c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35590/0 (socket says 172.21.15.50:35590) 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b9d9c700 1 -- 172.21.15.50:0/2773642642 learned_addr learned my addr 172.21.15.50:0/2773642642 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.611+0000 7f06b8d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50172/0 (socket says 172.21.15.50:50172) 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 -- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 msgr2=0x7f06b41328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b41328f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 -- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 msgr2=0x7f06b412c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 0x7f06b412c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 -- 172.21.15.50:0/2773642642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a400b180 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06b8d9a700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06a40139c0 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4013b20 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06a4013e80 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b4133230 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.612+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b4131910 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.613+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b40a2690 con 0x7f06b4139720 2022-05-02T09:39:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.614+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f06a401c070 con 0x7f06b4139720 2022-05-02T09:39:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.614+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f06a404a9c0 con 0x7f06b4139720 2022-05-02T09:39:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.617+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f06a401fd30 con 0x7f06b4139720 2022-05-02T09:39:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.742+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f06b4132730 con 0x7f06b4139720 2022-05-02T09:39:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.743+0000 7f06a27fc700 1 -- 172.21.15.50:0/2773642642 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v15) v1 ==== 110+0+10 (secure 0 0 0) 0x7f06b4132730 con 0x7f06b4139720 2022-05-02T09:39:07.745 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:39:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 >> v1:172.21.15.50:6800/30011 conn(0x7f0694038940 legacy=0x7f069403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 msgr2=0x7f06b412bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a4014000).stop 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 shutdown_connections 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f06b405cc50 0x7f06b41328f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06b4139b00 0x7f06b412c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 --2- 172.21.15.50:0/2773642642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06b4139720 0x7f06b412bdf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 >> 172.21.15.50:0/2773642642 conn(0x7f06b40669d0 msgr2=0x7f06b405fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 shutdown_connections 2022-05-02T09:39:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.745+0000 7f06ba59d700 1 -- 172.21.15.50:0/2773642642 wait complete. 2022-05-02T09:39:07.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:39:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.978+0000 7f8fde59d700 1 Processor -- start 2022-05-02T09:39:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.979+0000 7f8fde59d700 1 -- start start 2022-05-02T09:39:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fde59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 0x7f8fd805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fde59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fd8139b00 0x7f8fd805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fde59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd8139010 con 0x7f8fd805cc50 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fde59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd81392d0 con 0x7f8fd8139b00 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fde59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80a7c50 con 0x7f8fd8139720 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fdd59b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 0x7f8fd805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fddd9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8fd805cc50 0x7f8fd805fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52144/0 (socket says 172.21.15.50:52144) 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fdcd9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fd8139b00 0x7f8fd805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.980+0000 7f8fddd9c700 1 -- 172.21.15.50:0/3088036190 learned_addr learned my addr 172.21.15.50:0/3088036190 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fdd59b700 1 -- 172.21.15.50:0/3088036190 >> v2:172.21.15.50:3300/0 conn(0x7f8fd8139b00 msgr2=0x7f8fd805d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fdd59b700 1 --2- 172.21.15.50:0/3088036190 >> v2:172.21.15.50:3300/0 conn(0x7f8fd8139b00 0x7f8fd805d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fdd59b700 1 -- 172.21.15.50:0/3088036190 >> v1:172.21.15.50:6789/0 conn(0x7f8fd805cc50 legacy=0x7f8fd805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fdd59b700 1 -- 172.21.15.50:0/3088036190 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80a95d0 con 0x7f8fd8139720 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fdd59b700 1 --2- 172.21.15.50:0/3088036190 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 0x7f8fd805b8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8fd4002f70 tx=0x7f8fd4006df0).ready entity=mon.2 client_cookie=e88e4dbb0aece9bc server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fc7fff700 1 -- 172.21.15.50:0/3088036190 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd400d570 con 0x7f8fd8139720 2022-05-02T09:39:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fc7fff700 1 -- 172.21.15.50:0/3088036190 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4000e90 con 0x7f8fd8139720 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.981+0000 7f8fc7fff700 1 -- 172.21.15.50:0/3088036190 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd400d8c0 con 0x7f8fd8139720 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 -- 172.21.15.50:0/3088036190 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 msgr2=0x7f8fd805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 --2- 172.21.15.50:0/3088036190 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 0x7f8fd805b8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8fd4002f70 tx=0x7f8fd4006df0).stop 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 -- 172.21.15.50:0/3088036190 shutdown_connections 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 --2- 172.21.15.50:0/3088036190 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139720 0x7f8fd805b8a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 --2- 172.21.15.50:0/3088036190 >> v2:172.21.15.50:3300/0 conn(0x7f8fd8139b00 0x7f8fd805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 -- 172.21.15.50:0/3088036190 >> 172.21.15.50:0/3088036190 conn(0x7f8fd80669d0 msgr2=0x7f8fd80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 -- 172.21.15.50:0/3088036190 shutdown_connections 2022-05-02T09:39:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.982+0000 7f8fde59d700 1 -- 172.21.15.50:0/3088036190 wait complete. 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.983+0000 7f8fde59d700 1 Processor -- start 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.983+0000 7f8fde59d700 1 -- start start 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139b00 0x7f8fd812c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80a1e70 con 0x7f8fd8139720 2022-05-02T09:39:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80a2ab0 con 0x7f8fd805cc50 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fde59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8149200 con 0x7f8fd8139b00 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fdd59b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fddd9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139b00 0x7f8fd812c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fdcd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fdcd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35594/0 (socket says 172.21.15.50:35594) 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fdd59b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50176/0 (socket says 172.21.15.50:50176) 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.984+0000 7f8fdcd9a700 1 -- 172.21.15.50:0/1671809745 learned_addr learned my addr 172.21.15.50:0/1671809745 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 -- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139b00 msgr2=0x7f8fd812c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139b00 0x7f8fd812c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 -- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 msgr2=0x7f8fd81489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 -- 172.21.15.50:0/1671809745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd400b180 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdd59b700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.985+0000 7f8fdcd9a700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8fc800c000 tx=0x7f8fc8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.986+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc8011750 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.986+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc80118b0 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.986+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc8011c10 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.986+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd81494c0 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.986+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8148ea0 con 0x7f8fd8139720 2022-05-02T09:39:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.987+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f8fc8011d70 con 0x7f8fd8139720 2022-05-02T09:39:07.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.987+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd80a6670 con 0x7f8fd8139720 2022-05-02T09:39:07.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.987+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f8fc804a3a0 con 0x7f8fd8139720 2022-05-02T09:39:07.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:07.992+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8fc802f720 con 0x7f8fd8139720 2022-05-02T09:39:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.119+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8fd80a2760 con 0x7f8fd8139720 2022-05-02T09:39:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.120+0000 7f8fc67fc700 1 -- 172.21.15.50:0/1671809745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8fc8032d40 con 0x7f8fd8139720 2022-05-02T09:39:08.122 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.121+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 >> v1:172.21.15.50:6800/30011 conn(0x7f8fb80389d0 legacy=0x7f8fb803ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.121+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 msgr2=0x7f8fd812bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.121+0000 7f8fde59d700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8fc800c000 tx=0x7f8fc8006df0).stop 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 shutdown_connections 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8fd8139b00 0x7f8fd812c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fd805cc50 0x7f8fd81489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 --2- 172.21.15.50:0/1671809745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd8139720 0x7f8fd812bdf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 >> 172.21.15.50:0/1671809745 conn(0x7f8fd80669d0 msgr2=0x7f8fd805fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 shutdown_connections 2022-05-02T09:39:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.122+0000 7f8fde59d700 1 -- 172.21.15.50:0/1671809745 wait complete. 2022-05-02T09:39:08.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-05-02T09:39:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.350+0000 7fedb7fff700 1 Processor -- start 2022-05-02T09:39:08.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.350+0000 7fedb7fff700 1 -- start start 2022-05-02T09:39:08.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 0x7fedb805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 0x7fedb805fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb8139010 con 0x7fedb805cc50 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81392d0 con 0x7fedb8139b00 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.351+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80a7c50 con 0x7fedb8139720 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 0x7fedb805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 0x7fedb805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb67fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 0x7fedb805fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35598/0 (socket says 172.21.15.50:35598) 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb77fe700 1 -- 172.21.15.50:0/1659566286 learned_addr learned my addr 172.21.15.50:0/1659566286 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb67fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb805d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50178/0 (socket says 172.21.15.50:50178) 2022-05-02T09:39:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 msgr2=0x7fedb805d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb805d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1659566286 >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 msgr2=0x7fedb805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1659566286 >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 0x7fedb805fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.352+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1659566286 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80a95d0 con 0x7fedb8139720 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 0x7fedb805b8a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feda8002f70 tx=0x7feda8006df0).ready entity=mon.2 client_cookie=51dcfcd73f44b75d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb5ffb700 1 -- 172.21.15.50:0/1659566286 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda800d4a0 con 0x7fedb8139720 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb5ffb700 1 -- 172.21.15.50:0/1659566286 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8000e90 con 0x7fedb8139720 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb5ffb700 1 -- 172.21.15.50:0/1659566286 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda800d7f0 con 0x7fedb8139720 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb7fff700 1 -- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 msgr2=0x7fedb805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.353+0000 7fedb7fff700 1 --2- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 0x7fedb805b8a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feda8002f70 tx=0x7feda8006df0).stop 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 -- 172.21.15.50:0/1659566286 shutdown_connections 2022-05-02T09:39:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 --2- 172.21.15.50:0/1659566286 >> v2:172.21.15.50:3300/0 conn(0x7fedb805cc50 0x7fedb805fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 --2- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb8139720 0x7fedb805b8a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 --2- 172.21.15.50:0/1659566286 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 -- 172.21.15.50:0/1659566286 >> 172.21.15.50:0/1659566286 conn(0x7fedb80669d0 msgr2=0x7fedb80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 -- 172.21.15.50:0/1659566286 shutdown_connections 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.354+0000 7fedb7fff700 1 -- 172.21.15.50:0/1659566286 wait complete. 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.355+0000 7fedb7fff700 1 Processor -- start 2022-05-02T09:39:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.355+0000 7fedb7fff700 1 -- start start 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 0x7fedb8148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8149210 con 0x7fedb8139720 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81494b0 con 0x7fedb8139b00 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8135990 con 0x7fedb805cc50 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.362 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 0x7fedb8148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50180/0 (socket says 172.21.15.50:50180) 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb77fe700 1 -- 172.21.15.50:0/2224476531 learned_addr learned my addr 172.21.15.50:0/2224476531 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.356+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49500/0 (socket says 172.21.15.50:49500) 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 -- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 msgr2=0x7fedb80a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 -- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 msgr2=0x7fedb80a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 -- 172.21.15.50:0/2224476531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda800b180 con 0x7fedb8139720 2022-05-02T09:39:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb77fe700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 0x7fedb8148840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fedac00c000 tx=0x7fedac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedac011750 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0118b0 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb81362d0 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.357+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedac011c10 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.358+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80a3560 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.359+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fedac011d70 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.359+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb805d100 con 0x7fedb8139720 2022-05-02T09:39:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.360+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fedac04a1d0 con 0x7fedb8139720 2022-05-02T09:39:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.363+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fedac033090 con 0x7fedb8139720 2022-05-02T09:39:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.489+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fedb8057990 con 0x7fedb8139720 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.489+0000 7feda7fff700 1 -- 172.21.15.50:0/2224476531 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+143 (secure 0 0 0) 0x7fedac032c80 con 0x7fedb8139720 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2022-05-02T09:39:08.492 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "device_health_metrics" 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:39:08.493 INFO:teuthology.orchestra.run.smithi050.stdout:] 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 >> v1:172.21.15.50:6800/30011 conn(0x7fed94038940 legacy=0x7fed9403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 msgr2=0x7fedb8148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 0x7fedb8148840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fedac00c000 tx=0x7fedac006df0).stop 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 shutdown_connections 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fedb805cc50 0x7fedb80a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fedb8139b00 0x7fedb80a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 --2- 172.21.15.50:0/2224476531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8139720 0x7fedb8148840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 >> 172.21.15.50:0/2224476531 conn(0x7fedb80669d0 msgr2=0x7fedb80a6970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 shutdown_connections 2022-05-02T09:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.491+0000 7fedb7fff700 1 -- 172.21.15.50:0/2224476531 wait complete. 2022-05-02T09:39:08.517 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-05-02T09:39:08.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-05-02T09:39:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.724+0000 7f8cc099d700 1 Processor -- start 2022-05-02T09:39:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.725+0000 7f8cc099d700 1 -- start start 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cc099d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc05ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cc099d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc140920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cc099d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc05c290 con 0x7f8cbc136240 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cc099d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc136d30 con 0x7f8cbc05ca70 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cc099d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0a6ab0 con 0x7f8cbc13e530 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cbbfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cbb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cbc136240 0x7f8cbc136620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52146/0 (socket says 172.21.15.50:52146) 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cbaffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc05ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.726+0000 7f8cbb7fe700 1 -- 172.21.15.50:0/1775851894 learned_addr learned my addr 172.21.15.50:0/1775851894 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbaffd700 1 -- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 msgr2=0x7f8cbc140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbaffd700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cba7fc700 1 -- 172.21.15.50:0/1775851894 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111582346 0 0) 0x7f8cbc05c290 con 0x7f8cbc136240 2022-05-02T09:39:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbaffd700 1 -- 172.21.15.50:0/1775851894 >> v1:172.21.15.50:6789/0 conn(0x7f8cbc136240 legacy=0x7f8cbc136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbaffd700 1 -- 172.21.15.50:0/1775851894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0a6d50 con 0x7f8cbc05ca70 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbbfff700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cbaffd700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc05ce90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0006df0).ready entity=mon.1 client_cookie=ea53b88813a4b1cf server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cba7fc700 1 -- 172.21.15.50:0/1775851894 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000d570 con 0x7f8cbc05ca70 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cba7fc700 1 -- 172.21.15.50:0/1775851894 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0000e90 con 0x7f8cbc05ca70 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.727+0000 7f8cba7fc700 1 -- 172.21.15.50:0/1775851894 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000d8c0 con 0x7f8cbc05ca70 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 -- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 msgr2=0x7f8cbc05ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc05ce90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0006df0).stop 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 -- 172.21.15.50:0/1775851894 shutdown_connections 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 --2- 172.21.15.50:0/1775851894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc05ce90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 -- 172.21.15.50:0/1775851894 >> 172.21.15.50:0/1775851894 conn(0x7f8cbc066a80 msgr2=0x7f8cbc0ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 -- 172.21.15.50:0/1775851894 shutdown_connections 2022-05-02T09:39:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.728+0000 7f8cc099d700 1 -- 172.21.15.50:0/1775851894 wait complete. 2022-05-02T09:39:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.729+0000 7f8cc099d700 1 Processor -- start 2022-05-02T09:39:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.730+0000 7f8cc099d700 1 -- start start 2022-05-02T09:39:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.730+0000 7f8cc099d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.730+0000 7f8cc099d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 0x7f8cbc1311d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.730+0000 7f8cc099d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc1316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cc099d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc13c3e0 con 0x7f8cbc136240 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cc099d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc13c1e0 con 0x7f8cbc05ca70 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cc099d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0a1500 con 0x7f8cbc13e530 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50184/0 (socket says 172.21.15.50:50184) 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 -- 172.21.15.50:0/6223552 learned_addr learned my addr 172.21.15.50:0/6223552 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbaffd700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 0x7f8cbc1311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbbfff700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc1316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 -- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 msgr2=0x7f8cbc1316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc1316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 -- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 msgr2=0x7f8cbc1311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 0x7f8cbc1311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbb7fe700 1 -- 172.21.15.50:0/6223552 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4009470 con 0x7f8cbc05ca70 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.731+0000 7f8cbaffd700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 0x7f8cbc1311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cbb7fe700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8cac000bc0 tx=0x7f8cac007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cac00ce50 con 0x7f8cbc05ca70 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0072e0 con 0x7f8cbc05ca70 2022-05-02T09:39:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cac005800 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb000b180 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.732+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc0a1cc0 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.733+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc060710 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.733+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f8cac010070 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.734+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f8cac049730 con 0x7f8cbc05ca70 2022-05-02T09:39:08.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.737+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8cac02ebc0 con 0x7f8cbc05ca70 2022-05-02T09:39:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:08.864+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8cbc057990 con 0x7f8cbc05ca70 2022-05-02T09:39:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.853+0000 7f8cb8ff9700 1 -- 172.21.15.50:0/6223552 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v16) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8cac0321e0 con 0x7f8cbc05ca70 2022-05-02T09:39:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.858+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 >> v1:172.21.15.50:6800/30011 conn(0x7f8c9c038a90 legacy=0x7f8c9c03af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.858+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 msgr2=0x7f8cbc0a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.858+0000 7f8cc099d700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8cac000bc0 tx=0x7f8cac007a60).stop 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.859+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 shutdown_connections 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.859+0000 7f8cc099d700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8cbc13e530 0x7f8cbc1316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.859+0000 7f8cc099d700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8cbc05ca70 0x7f8cbc0a0730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.859+0000 7f8cc099d700 1 --2- 172.21.15.50:0/6223552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc136240 0x7f8cbc1311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.859+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 >> 172.21.15.50:0/6223552 conn(0x7f8cbc066a80 msgr2=0x7f8cbc0a76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:09.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.860+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 shutdown_connections 2022-05-02T09:39:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:09.861+0000 7f8cc099d700 1 -- 172.21.15.50:0/6223552 wait complete. 2022-05-02T09:39:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2022-05-02T09:39:09.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-05-02T09:39:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.109+0000 7fd2a179d700 1 Processor -- start 2022-05-02T09:39:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.109+0000 7fd2a179d700 1 -- start start 2022-05-02T09:39:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a179d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a179d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd29c094350 0x7fd29c0a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a179d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c095880 con 0x7fd29c133940 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a179d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c095b60 con 0x7fd29c094350 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a179d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c137300 con 0x7fd29c096080 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd29bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd29b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd29c094350 0x7fd29c0a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd29bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50186/0 (socket says 172.21.15.50:50186) 2022-05-02T09:39:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd29bfff700 1 -- 172.21.15.50:0/3827705514 learned_addr learned my addr 172.21.15.50:0/3827705514 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.110+0000 7fd2a0f9c700 1 --1- 172.21.15.50:0/3827705514 >> v1:172.21.15.50:6789/0 conn(0x7fd29c133940 0x7fd29c133df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52148/0 (socket says 172.21.15.50:52148) 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29bfff700 1 -- 172.21.15.50:0/3827705514 >> v2:172.21.15.50:3300/0 conn(0x7fd29c094350 msgr2=0x7fd29c0a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29bfff700 1 --2- 172.21.15.50:0/3827705514 >> v2:172.21.15.50:3300/0 conn(0x7fd29c094350 0x7fd29c0a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29bfff700 1 -- 172.21.15.50:0/3827705514 >> v1:172.21.15.50:6789/0 conn(0x7fd29c133940 legacy=0x7fd29c133df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29bfff700 1 -- 172.21.15.50:0/3827705514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0a8b10 con 0x7fd29c096080 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29bfff700 1 --2- 172.21.15.50:0/3827705514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd28c002f70 tx=0x7fd28c006eb0).ready entity=mon.1 client_cookie=92c9f667477a9288 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29affd700 1 -- 172.21.15.50:0/3827705514 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd28c00d570 con 0x7fd29c096080 2022-05-02T09:39:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29affd700 1 -- 172.21.15.50:0/3827705514 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c000e90 con 0x7fd29c096080 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.111+0000 7fd29affd700 1 -- 172.21.15.50:0/3827705514 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd28c00d900 con 0x7fd29c096080 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 -- 172.21.15.50:0/3827705514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 msgr2=0x7fd29c136e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3827705514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd28c002f70 tx=0x7fd28c006eb0).stop 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 -- 172.21.15.50:0/3827705514 shutdown_connections 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3827705514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c096080 0x7fd29c136e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3827705514 >> v2:172.21.15.50:3300/0 conn(0x7fd29c094350 0x7fd29c0a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 -- 172.21.15.50:0/3827705514 >> 172.21.15.50:0/3827705514 conn(0x7fd29c05b8a0 msgr2=0x7fd29c05bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 -- 172.21.15.50:0/3827705514 shutdown_connections 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.112+0000 7fd2a179d700 1 -- 172.21.15.50:0/3827705514 wait complete. 2022-05-02T09:39:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.113+0000 7fd2a179d700 1 Processor -- start 2022-05-02T09:39:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.113+0000 7fd2a179d700 1 -- start start 2022-05-02T09:39:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 0x7fd29c063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 0x7fd29c0612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0637b0 con 0x7fd29c096080 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c063a70 con 0x7fd29c133940 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.114+0000 7fd2a179d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0655e0 con 0x7fd29c094350 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 0x7fd29c063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35606/0 (socket says 172.21.15.50:35606) 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29b7fe700 1 -- 172.21.15.50:0/3521966255 learned_addr learned my addr 172.21.15.50:0/3521966255 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd2a0f9c700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 0x7fd29c0612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 -- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 msgr2=0x7fd29c0612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 0x7fd29c0612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 -- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 msgr2=0x7fd29c060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29bfff700 1 -- 172.21.15.50:0/3521966255 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c00b1e0 con 0x7fd29c094350 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd29b7fe700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.115+0000 7fd2a0f9c700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 0x7fd29c0612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd29bfff700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 0x7fd29c063190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd28c002f70 tx=0x7fd28c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd28c011610 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c011770 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd28c011ad0 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c136d30 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.116+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0622d0 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.117+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c06c070 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.118+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fd28c01a040 con 0x7fd29c094350 2022-05-02T09:39:10.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.118+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3192+0+0 (secure 0 0 0) 0x7fd28c04ada0 con 0x7fd29c094350 2022-05-02T09:39:10.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.121+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd28c0082b0 con 0x7fd29c094350 2022-05-02T09:39:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.249+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd29c137570 con 0x7fd29c094350 2022-05-02T09:39:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.860+0000 7fd2997fa700 1 -- 172.21.15.50:0/3521966255 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v17) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd28c01e460 con 0x7fd29c094350 2022-05-02T09:39:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.869+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 >> v1:172.21.15.50:6800/30011 conn(0x7fd27c038940 legacy=0x7fd27c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.869+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 msgr2=0x7fd29c063190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:10.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.869+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 0x7fd29c063190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd28c002f70 tx=0x7fd28c015000).stop 2022-05-02T09:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.872+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 shutdown_connections 2022-05-02T09:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.872+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd29c094350 0x7fd29c063190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.872+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c133940 0x7fd29c0612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.872+0000 7fd2a179d700 1 --2- 172.21.15.50:0/3521966255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c096080 0x7fd29c060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.872+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 >> 172.21.15.50:0/3521966255 conn(0x7fd29c05b8a0 msgr2=0x7fd29c133df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.876+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 shutdown_connections 2022-05-02T09:39:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:10.876+0000 7fd2a179d700 1 -- 172.21.15.50:0/3521966255 wait complete. 2022-05-02T09:39:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2022-05-02T09:39:10.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-05-02T09:39:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.128+0000 7f9e8dd9d700 1 Processor -- start 2022-05-02T09:39:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.129+0000 7f9e8dd9d700 1 -- start start 2022-05-02T09:39:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8dd9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e880a8330 0x7f9e880a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8dd9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 0x7f9e88135660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8dd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e88092240 con 0x7f9e88135b50 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8dd9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e88094f00 con 0x7f9e880a8330 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8dd9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88094410 con 0x7f9e880a7560 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8cd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e880a8330 0x7f9e880a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e87fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 0x7f9e88135660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8d59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e88135b50 0x7f9e8813ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52150/0 (socket says 172.21.15.50:52150) 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e87fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 0x7f9e88135660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49508/0 (socket says 172.21.15.50:49508) 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e87fff700 1 -- 172.21.15.50:0/1585476151 learned_addr learned my addr 172.21.15.50:0/1585476151 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.130+0000 7f9e8cd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e880a8330 0x7f9e880a8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35608/0 (socket says 172.21.15.50:35608) 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 msgr2=0x7f9e88135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e8cd9b700 1 --2- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 0x7f9e88135660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1585476151 >> v1:172.21.15.50:6789/0 conn(0x7f9e88135b50 legacy=0x7f9e8813ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1585476151 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880926c0 con 0x7f9e880a8330 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e8cd9b700 1 --2- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e880a8710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9e7c002f70 tx=0x7f9e7c00a200).ready entity=mon.0 client_cookie=c807d036d1d170ec server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e877fe700 1 -- 172.21.15.50:0/1585476151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c00d980 con 0x7f9e880a8330 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e877fe700 1 -- 172.21.15.50:0/1585476151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c000e90 con 0x7f9e880a8330 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.131+0000 7f9e877fe700 1 -- 172.21.15.50:0/1585476151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c00dcd0 con 0x7f9e880a8330 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 msgr2=0x7f9e880a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e880a8710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9e7c002f70 tx=0x7f9e7c00a200).stop 2022-05-02T09:39:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1585476151 shutdown_connections 2022-05-02T09:39:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e880a8710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1585476151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e880a7560 0x7f9e88135660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1585476151 >> 172.21.15.50:0/1585476151 conn(0x7f9e8805b8a0 msgr2=0x7f9e8805bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1585476151 shutdown_connections 2022-05-02T09:39:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.132+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1585476151 wait complete. 2022-05-02T09:39:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.133+0000 7f9e8dd9d700 1 Processor -- start 2022-05-02T09:39:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.133+0000 7f9e8dd9d700 1 -- start start 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e88066c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e88135b50 0x7f9e880657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88067790 con 0x7f9e880a8330 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88067100 con 0x7f9e880a7560 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8dd9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88141ae0 con 0x7f9e88135b50 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8cd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8cd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50190/0 (socket says 172.21.15.50:50190) 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e88066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1330707349 learned_addr learned my addr 172.21.15.50:0/1330707349 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.134+0000 7f9e8d59c700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e88135b50 0x7f9e880657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e88135b50 msgr2=0x7f9e880657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e88135b50 0x7f9e880657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 msgr2=0x7f9e88066c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e88066c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 -- 172.21.15.50:0/1330707349 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c006e30 con 0x7f9e880a7560 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e87fff700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e88066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.135+0000 7f9e8cd9b700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e7c006fc0 tx=0x7f9e7c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.136+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c01c070 con 0x7f9e880a7560 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.136+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00dd80 con 0x7f9e880a7560 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.136+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c020600 con 0x7f9e880a7560 2022-05-02T09:39:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.136+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e88065cb0 con 0x7f9e880a7560 2022-05-02T09:39:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.136+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e880647e0 con 0x7f9e880a7560 2022-05-02T09:39:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.137+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8806c070 con 0x7f9e880a7560 2022-05-02T09:39:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.137+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f9e7c027030 con 0x7f9e880a7560 2022-05-02T09:39:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.138+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3574+0+0 (secure 0 0 0) 0x7f9e7c04b830 con 0x7f9e880a7560 2022-05-02T09:39:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.141+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9e7c020990 con 0x7f9e880a7560 2022-05-02T09:39:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.301+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9e880a7980 con 0x7f9e880a7560 2022-05-02T09:39:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.310+0000 7f9e85ffb700 1 -- 172.21.15.50:0/1330707349 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9e7c025020 con 0x7f9e880a7560 2022-05-02T09:39:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.323+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 >> v1:172.21.15.50:6800/30011 conn(0x7f9e68038940 legacy=0x7f9e6803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.323+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 msgr2=0x7f9e8809bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.326 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.323+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e7c006fc0 tx=0x7f9e7c016000).stop 2022-05-02T09:39:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.327+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 shutdown_connections 2022-05-02T09:39:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.327+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9e88135b50 0x7f9e880657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.327+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e880a7560 0x7f9e8809bbd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.327+0000 7f9e8dd9d700 1 --2- 172.21.15.50:0/1330707349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880a8330 0x7f9e88066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.327+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 >> 172.21.15.50:0/1330707349 conn(0x7f9e8805b8a0 msgr2=0x7f9e880a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:11.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.329+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 shutdown_connections 2022-05-02T09:39:11.337 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.332+0000 7f9e8dd9d700 1 -- 172.21.15.50:0/1330707349 wait complete. 2022-05-02T09:39:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 3 and data pool 4 2022-05-02T09:39:11.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.581+0000 7f0e1359d700 1 Processor -- start 2022-05-02T09:39:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.581+0000 7f0e1359d700 1 -- start start 2022-05-02T09:39:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.582+0000 7f0e1359d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e0c139b00 0x7f0e0c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.582+0000 7f0e1359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 0x7f0e0c1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.582+0000 7f0e1359d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c05d360 con 0x7f0e0c139720 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.582+0000 7f0e1359d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c139010 con 0x7f0e0c139b00 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.582+0000 7f0e1359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c1392d0 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e1259b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e0c139720 0x7f0e0c05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52152/0 (socket says 172.21.15.50:52152) 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e1259b700 1 -- 172.21.15.50:0/1609681545 learned_addr learned my addr 172.21.15.50:0/1609681545 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e12d9c700 1 --2- 172.21.15.50:0/1609681545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 0x7f0e0c1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e11d9a700 1 --2- 172.21.15.50:0/1609681545 >> v2:172.21.15.50:3300/0 conn(0x7f0e0c139b00 0x7f0e0c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e11599700 1 -- 172.21.15.50:0/1609681545 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129758171 0 0) 0x7f0e0c05d360 con 0x7f0e0c139720 2022-05-02T09:39:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e11599700 1 -- 172.21.15.50:0/1609681545 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df4003260 con 0x7f0e0c139720 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e12d9c700 1 -- 172.21.15.50:0/1609681545 >> v2:172.21.15.50:3300/0 conn(0x7f0e0c139b00 msgr2=0x7f0e0c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e12d9c700 1 --2- 172.21.15.50:0/1609681545 >> v2:172.21.15.50:3300/0 conn(0x7f0e0c139b00 0x7f0e0c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e12d9c700 1 -- 172.21.15.50:0/1609681545 >> v1:172.21.15.50:6789/0 conn(0x7f0e0c139720 legacy=0x7f0e0c05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.583+0000 7f0e12d9c700 1 -- 172.21.15.50:0/1609681545 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0a7c50 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e12d9c700 1 --2- 172.21.15.50:0/1609681545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 0x7f0e0c1402a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0e040032f0 tx=0x7f0e040091d0).ready entity=mon.1 client_cookie=258ffec70b00245a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e11599700 1 -- 172.21.15.50:0/1609681545 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400b600 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e11599700 1 -- 172.21.15.50:0/1609681545 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400b760 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e11599700 1 -- 172.21.15.50:0/1609681545 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400b8d0 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e1359d700 1 -- 172.21.15.50:0/1609681545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 msgr2=0x7f0e0c1402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.584+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1609681545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 0x7f0e0c1402a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0e040032f0 tx=0x7f0e040091d0).stop 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 -- 172.21.15.50:0/1609681545 shutdown_connections 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1609681545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c05d7d0 0x7f0e0c1402a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1609681545 >> v2:172.21.15.50:3300/0 conn(0x7f0e0c139b00 0x7f0e0c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 -- 172.21.15.50:0/1609681545 >> 172.21.15.50:0/1609681545 conn(0x7f0e0c0669d0 msgr2=0x7f0e0c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 -- 172.21.15.50:0/1609681545 shutdown_connections 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.585+0000 7f0e1359d700 1 -- 172.21.15.50:0/1609681545 wait complete. 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.586+0000 7f0e1359d700 1 Processor -- start 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.586+0000 7f0e1359d700 1 -- start start 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 0x7f0e0c148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c139b00 0x7f0e0c148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0a1a40 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c1300c0 con 0x7f0e0c139b00 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c130360 con 0x7f0e0c139720 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35614/0 (socket says 172.21.15.50:35614) 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e1259b700 1 -- 172.21.15.50:0/1852525413 learned_addr learned my addr 172.21.15.50:0/1852525413 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e11d9a700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 0x7f0e0c148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.587+0000 7f0e12d9c700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c139b00 0x7f0e0c148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 -- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 msgr2=0x7f0e0c148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 0x7f0e0c148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 -- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c139b00 msgr2=0x7f0e0c148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c139b00 0x7f0e0c148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 -- 172.21.15.50:0/1852525413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009470 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e11d9a700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 0x7f0e0c148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0e1259b700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0e08001110 tx=0x7f0e08007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.588+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e080070d0 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.589+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08007230 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.589+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08005610 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.589+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c131a50 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.589+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c1326b0 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.590+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c057990 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.590+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0e08010070 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.591+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0e08049a40 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.594+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0e0802ea70 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.717+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e0c061b40 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.718+0000 7f0dfb7fe700 1 -- 172.21.15.50:0/1852525413 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10549 (secure 0 0 0) 0x7f0e08032090 con 0x7f0e0c05d7d0 2022-05-02T09:39:11.720 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:11.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:11.302428+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:11.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 >> v1:172.21.15.50:6800/30011 conn(0x7f0dec038a60 legacy=0x7f0dec03af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 msgr2=0x7f0e0c0a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0e08001110 tx=0x7f0e08007ad0).stop 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 shutdown_connections 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e0c139b00 0x7f0e0c148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c05d7d0 0x7f0e0c0a1f40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 --2- 172.21.15.50:0/1852525413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e0c139720 0x7f0e0c148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 >> 172.21.15.50:0/1852525413 conn(0x7f0e0c0669d0 msgr2=0x7f0e0c05cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 shutdown_connections 2022-05-02T09:39:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.720+0000 7f0e1359d700 1 -- 172.21.15.50:0/1852525413 wait complete. 2022-05-02T09:39:11.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.951+0000 7f54e7fff700 1 Processor -- start 2022-05-02T09:39:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.951+0000 7f54e7fff700 1 -- start start 2022-05-02T09:39:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 0x7f54e805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e805cc50 0x7f54e805fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e8139010 con 0x7f54e8139720 2022-05-02T09:39:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e81392d0 con 0x7f54e805cc50 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.952+0000 7f54e7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80a7c50 con 0x7f54e8139b00 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 0x7f54e805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e805cc50 0x7f54e805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49514/0 (socket says 172.21.15.50:49514) 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 0x7f54e805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35616/0 (socket says 172.21.15.50:35616) 2022-05-02T09:39:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 -- 172.21.15.50:0/1034089819 learned_addr learned my addr 172.21.15.50:0/1034089819 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:11.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 -- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e805cc50 msgr2=0x7f54e805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:11.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 --2- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e805cc50 0x7f54e805fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 -- 172.21.15.50:0/1034089819 >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 msgr2=0x7f54e805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 --2- 172.21.15.50:0/1034089819 >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 0x7f54e805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.953+0000 7f54e67fc700 1 -- 172.21.15.50:0/1034089819 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80a95d0 con 0x7f54e8139b00 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e67fc700 1 --2- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f54dc002f70 tx=0x7f54dc006eb0).ready entity=mon.2 client_cookie=716ac25e6a544766 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e5ffb700 1 -- 172.21.15.50:0/1034089819 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc00d570 con 0x7f54e8139b00 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e5ffb700 1 -- 172.21.15.50:0/1034089819 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc000e90 con 0x7f54e8139b00 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e5ffb700 1 -- 172.21.15.50:0/1034089819 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc00d900 con 0x7f54e8139b00 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 -- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 msgr2=0x7f54e805d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 --2- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f54dc002f70 tx=0x7f54dc006eb0).stop 2022-05-02T09:39:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 -- 172.21.15.50:0/1034089819 shutdown_connections 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 --2- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e805cc50 0x7f54e805fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 --2- 172.21.15.50:0/1034089819 >> v2:172.21.15.50:3300/0 conn(0x7f54e8139720 0x7f54e805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 --2- 172.21.15.50:0/1034089819 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e8139b00 0x7f54e805d7d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.954+0000 7f54e7fff700 1 -- 172.21.15.50:0/1034089819 >> 172.21.15.50:0/1034089819 conn(0x7f54e80669d0 msgr2=0x7f54e80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.955+0000 7f54e7fff700 1 -- 172.21.15.50:0/1034089819 shutdown_connections 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.955+0000 7f54e7fff700 1 -- 172.21.15.50:0/1034089819 wait complete. 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.956+0000 7f54e7fff700 1 Processor -- start 2022-05-02T09:39:11.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.956+0000 7f54e7fff700 1 -- start start 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 0x7f54e81325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e8139720 0x7f54e80a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80a1aa0 con 0x7f54e8139b00 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80a1d40 con 0x7f54e8139720 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8132150 con 0x7f54e805cc50 2022-05-02T09:39:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e6ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 0x7f54e81325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35618/0 (socket says 172.21.15.50:35618) 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e77fe700 1 -- 172.21.15.50:0/661522410 learned_addr learned my addr 172.21.15.50:0/661522410 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.957+0000 7f54e67fc700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e8139720 0x7f54e80a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 -- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e8139720 msgr2=0x7f54e80a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e8139720 0x7f54e80a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 -- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 msgr2=0x7f54e80a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 -- 172.21.15.50:0/661522410 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc00b1e0 con 0x7f54e805cc50 2022-05-02T09:39:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e77fe700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e6ffd700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 0x7f54e81325f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f54d800c000 tx=0x7f54d8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d8010780 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d80108e0 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e80a1680 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d8010c40 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.958+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e80a2fd0 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.959+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f54d801b400 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.960+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8132310 con 0x7f54e805cc50 2022-05-02T09:39:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.960+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f54d804a400 con 0x7f54e805cc50 2022-05-02T09:39:11.966 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:11.964+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f54d8032e60 con 0x7f54e805cc50 2022-05-02T09:39:12.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.088+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54e805d0e0 con 0x7f54e805cc50 2022-05-02T09:39:12.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.089+0000 7f54d7fff700 1 -- 172.21.15.50:0/661522410 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10549 (secure 0 0 0) 0x7f54d8032a50 con 0x7f54e805cc50 2022-05-02T09:39:12.092 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:12.092 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:11.302428+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 >> v1:172.21.15.50:6800/30011 conn(0x7f54c4038970 legacy=0x7f54c403ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 msgr2=0x7f54e81325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 0x7f54e81325f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f54d800c000 tx=0x7f54d8006df0).stop 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 shutdown_connections 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54e805cc50 0x7f54e81325f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54e8139b00 0x7f54e80a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 --2- 172.21.15.50:0/661522410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54e8139720 0x7f54e80a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 >> 172.21.15.50:0/661522410 conn(0x7f54e80669d0 msgr2=0x7f54e80a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 shutdown_connections 2022-05-02T09:39:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.091+0000 7f54e7fff700 1 -- 172.21.15.50:0/661522410 wait complete. 2022-05-02T09:39:12.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-05-02T09:39:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.328+0000 7fe9f199d700 1 Processor -- start 2022-05-02T09:39:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.328+0000 7fe9f199d700 1 -- start start 2022-05-02T09:39:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f199d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139720 0x7fe9ec05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f199d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9ec139b00 0x7fe9ec05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f199d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec139010 con 0x7fe9ec05cc50 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f199d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec1392d0 con 0x7fe9ec139b00 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f199d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0a7c50 con 0x7fe9ec139720 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9ebfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9ec139b00 0x7fe9ec05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f099b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139720 0x7fe9ec05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f119c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9ec05cc50 0x7fe9ec05fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52154/0 (socket says 172.21.15.50:52154) 2022-05-02T09:39:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.329+0000 7fe9f119c700 1 -- 172.21.15.50:0/3879275505 learned_addr learned my addr 172.21.15.50:0/3879275505 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.330+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139720 msgr2=0x7fe9ec05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.330+0000 7fe9ebfff700 1 --2- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139720 0x7fe9ec05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.330+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3879275505 >> v1:172.21.15.50:6789/0 conn(0x7fe9ec05cc50 legacy=0x7fe9ec05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.330+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3879275505 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0a95d0 con 0x7fe9ec139b00 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.330+0000 7fe9ebfff700 1 --2- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139b00 0x7fe9ec05d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe9d8002f70 tx=0x7fe9d8006df0).ready entity=mon.0 client_cookie=23e15aca309a447e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9eb7fe700 1 -- 172.21.15.50:0/3879275505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d800d570 con 0x7fe9ec139b00 2022-05-02T09:39:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9eb7fe700 1 -- 172.21.15.50:0/3879275505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8000e90 con 0x7fe9ec139b00 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9eb7fe700 1 -- 172.21.15.50:0/3879275505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d800d8c0 con 0x7fe9ec139b00 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 -- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139b00 msgr2=0x7fe9ec05d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139b00 0x7fe9ec05d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe9d8002f70 tx=0x7fe9d8006df0).stop 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 -- 172.21.15.50:0/3879275505 shutdown_connections 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139720 0x7fe9ec05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3879275505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139b00 0x7fe9ec05d7d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 -- 172.21.15.50:0/3879275505 >> 172.21.15.50:0/3879275505 conn(0x7fe9ec0669d0 msgr2=0x7fe9ec0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 -- 172.21.15.50:0/3879275505 shutdown_connections 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.331+0000 7fe9f199d700 1 -- 172.21.15.50:0/3879275505 wait complete. 2022-05-02T09:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.332+0000 7fe9f199d700 1 Processor -- start 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.333+0000 7fe9f199d700 1 -- start start 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.333+0000 7fe9f199d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.333+0000 7fe9f199d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 0x7fe9ec148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f199d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139b00 0x7fe9ec149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f199d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0a19b0 con 0x7fe9ec139720 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f199d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec146180 con 0x7fe9ec05cc50 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f199d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec132340 con 0x7fe9ec139b00 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f099b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 0x7fe9ec148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f099b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50200/0 (socket says 172.21.15.50:50200) 2022-05-02T09:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f099b700 1 -- 172.21.15.50:0/3231416151 learned_addr learned my addr 172.21.15.50:0/3231416151 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f119c700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139b00 0x7fe9ec149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139b00 msgr2=0x7fe9ec149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139b00 0x7fe9ec149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 msgr2=0x7fe9ec1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9ebfff700 1 -- 172.21.15.50:0/3231416151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d800b180 con 0x7fe9ec139720 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.334+0000 7fe9f099b700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9ebfff700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 0x7fe9ec148ca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe9d8002f70 tx=0x7fe9d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8013de0 con 0x7fe9ec139720 2022-05-02T09:39:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d801e400 con 0x7fe9ec139720 2022-05-02T09:39:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec131d80 con 0x7fe9ec139720 2022-05-02T09:39:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d801e760 con 0x7fe9ec139720 2022-05-02T09:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.335+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0a26f0 con 0x7fe9ec139720 2022-05-02T09:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.336+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec057990 con 0x7fe9ec139720 2022-05-02T09:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.336+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fe9d8025030 con 0x7fe9ec139720 2022-05-02T09:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.337+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe9d804af80 con 0x7fe9ec139720 2022-05-02T09:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.340+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe9d8006320 con 0x7fe9ec139720 2022-05-02T09:39:12.500 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:12.498+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9ec061b40 con 0x7fe9ec139720 2022-05-02T09:39:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.322+0000 7fe9e9ffb700 1 -- 172.21.15.50:0/3231416151 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9d8023030 con 0x7fe9ec139720 2022-05-02T09:39:13.327 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.324+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 >> v1:172.21.15.50:6800/30011 conn(0x7fe9cc038a00 legacy=0x7fe9cc03aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.324+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 msgr2=0x7fe9ec148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.324+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 0x7fe9ec148ca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe9d8002f70 tx=0x7fe9d8014000).stop 2022-05-02T09:39:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 shutdown_connections 2022-05-02T09:39:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe9ec139b00 0x7fe9ec149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9ec05cc50 0x7fe9ec1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 --2- 172.21.15.50:0/3231416151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9ec139720 0x7fe9ec148ca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 >> 172.21.15.50:0/3231416151 conn(0x7fe9ec0669d0 msgr2=0x7fe9ec05fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 shutdown_connections 2022-05-02T09:39:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.325+0000 7fe9f199d700 1 -- 172.21.15.50:0/3231416151 wait complete. 2022-05-02T09:39:13.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2022-05-02T09:39:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.596+0000 7fe03d39d700 1 Processor -- start 2022-05-02T09:39:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.596+0000 7fe03d39d700 1 -- start start 2022-05-02T09:39:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.597+0000 7fe03d39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.597+0000 7fe03d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.597+0000 7fe03d39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03805d360 con 0x7fe038139720 2022-05-02T09:39:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.597+0000 7fe03d39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe038139010 con 0x7fe038139b00 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.597+0000 7fe03d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0381392d0 con 0x7fe03805d7d0 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe0377fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50202/0 (socket says 172.21.15.50:50202) 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe0377fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35624/0 (socket says 172.21.15.50:35624) 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3666399586 learned_addr learned my addr 172.21.15.50:0/3666399586 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe037fff700 1 --1- 172.21.15.50:0/3666399586 >> v1:172.21.15.50:6789/0 conn(0x7fe038139720 0x7fe03805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52156/0 (socket says 172.21.15.50:52156) 2022-05-02T09:39:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3666399586 >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 msgr2=0x7fe03805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 --2- 172.21.15.50:0/3666399586 >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3666399586 >> v1:172.21.15.50:6789/0 conn(0x7fe038139720 legacy=0x7fe03805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3666399586 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380a7c50 con 0x7fe03805d7d0 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.598+0000 7fe0377fe700 1 --2- 172.21.15.50:0/3666399586 >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe03cb9c700 1 --2- 172.21.15.50:0/3666399586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe0300032f0 tx=0x7fe030009290).ready entity=mon.1 client_cookie=6a9c830ce84f801 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe036ffd700 1 -- 172.21.15.50:0/3666399586 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe03000b8a0 con 0x7fe03805d7d0 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe036ffd700 1 -- 172.21.15.50:0/3666399586 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03000ba00 con 0x7fe03805d7d0 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe036ffd700 1 -- 172.21.15.50:0/3666399586 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe03000bb70 con 0x7fe03805d7d0 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe03d39d700 1 -- 172.21.15.50:0/3666399586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 msgr2=0x7fe0381402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.599+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3666399586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe0300032f0 tx=0x7fe030009290).stop 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 -- 172.21.15.50:0/3666399586 shutdown_connections 2022-05-02T09:39:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3666399586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe03805d7d0 0x7fe0381402a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3666399586 >> v2:172.21.15.50:3300/0 conn(0x7fe038139b00 0x7fe03805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 -- 172.21.15.50:0/3666399586 >> 172.21.15.50:0/3666399586 conn(0x7fe0380669d0 msgr2=0x7fe0380a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 -- 172.21.15.50:0/3666399586 shutdown_connections 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.600+0000 7fe03d39d700 1 -- 172.21.15.50:0/3666399586 wait complete. 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.601+0000 7fe03d39d700 1 Processor -- start 2022-05-02T09:39:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.601+0000 7fe03d39d700 1 -- start start 2022-05-02T09:39:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03805d7d0 0x7fe0380a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe038139720 0x7fe0381488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380a0dd0 con 0x7fe03805d7d0 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380a2220 con 0x7fe038139b00 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380a1630 con 0x7fe038139720 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe037fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03805d7d0 0x7fe0380a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50204/0 (socket says 172.21.15.50:50204) 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3119961197 learned_addr learned my addr 172.21.15.50:0/3119961197 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.602+0000 7fe0377fe700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe038139720 0x7fe0381488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe038139720 msgr2=0x7fe0381488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe038139720 0x7fe0381488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03805d7d0 msgr2=0x7fe0380a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03805d7d0 0x7fe0380a1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 -- 172.21.15.50:0/3119961197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c00b180 con 0x7fe038139b00 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03cb9c700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe0300032f0 tx=0x7fe030016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe03000b8a0 con 0x7fe038139b00 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030021480 con 0x7fe038139b00 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe030009530 con 0x7fe038139b00 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0300217e0 con 0x7fe038139b00 2022-05-02T09:39:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.603+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0380a1ab0 con 0x7fe038139b00 2022-05-02T09:39:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.605+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0380a07f0 con 0x7fe038139b00 2022-05-02T09:39:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.605+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fe030028070 con 0x7fe038139b00 2022-05-02T09:39:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.605+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe03004ade0 con 0x7fe038139b00 2022-05-02T09:39:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.609+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe030002b80 con 0x7fe038139b00 2022-05-02T09:39:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:13.767+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fe038057990 con 0x7fe038139b00 2022-05-02T09:39:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.325+0000 7fe0357fa700 1 -- 172.21.15.50:0/3119961197 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe030015020 con 0x7fe038139b00 2022-05-02T09:39:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.329+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 >> v1:172.21.15.50:6800/30011 conn(0x7fe0180389d0 legacy=0x7fe01803ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.329+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 msgr2=0x7fe038148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.329+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe0300032f0 tx=0x7fe030016000).stop 2022-05-02T09:39:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 shutdown_connections 2022-05-02T09:39:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe038139b00 0x7fe038148dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03805d7d0 0x7fe0380a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 --2- 172.21.15.50:0/3119961197 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe038139720 0x7fe0381488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 >> 172.21.15.50:0/3119961197 conn(0x7fe0380669d0 msgr2=0x7fe038137450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.331+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 shutdown_connections 2022-05-02T09:39:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.332+0000 7fe03d39d700 1 -- 172.21.15.50:0/3119961197 wait complete. 2022-05-02T09:39:14.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-05-02T09:39:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.575+0000 7f82049fe700 1 Processor -- start 2022-05-02T09:39:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.576+0000 7f82049fe700 1 -- start start 2022-05-02T09:39:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f820005d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 0x7f820005fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8200139010 con 0x7f820005cc50 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82001392d0 con 0x7f8200139b00 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f82049fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82000a7c50 con 0x7f8200139720 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81ff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 0x7f820005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81fed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81fe59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f820005d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81ff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 0x7f820005fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35628/0 (socket says 172.21.15.50:35628) 2022-05-02T09:39:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81ff59e700 1 -- 172.21.15.50:0/1247771203 learned_addr learned my addr 172.21.15.50:0/1247771203 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.577+0000 7f81fed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49524/0 (socket says 172.21.15.50:49524) 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 -- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 msgr2=0x7f820005b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 -- 172.21.15.50:0/1247771203 >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 msgr2=0x7f820005fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 --2- 172.21.15.50:0/1247771203 >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 0x7f820005fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 -- 172.21.15.50:0/1247771203 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000a95d0 con 0x7f8200139b00 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fed9d700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fe59c700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f820005d7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f81f4002f70 tx=0x7f81f4006df0).ready entity=mon.1 client_cookie=be5495dccd26394e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fdd9b700 1 -- 172.21.15.50:0/1247771203 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f400d4a0 con 0x7f8200139b00 2022-05-02T09:39:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fdd9b700 1 -- 172.21.15.50:0/1247771203 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4000e90 con 0x7f8200139b00 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.578+0000 7f81fdd9b700 1 -- 172.21.15.50:0/1247771203 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f400d7f0 con 0x7f8200139b00 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 -- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 msgr2=0x7f820005d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f820005d7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f81f4002f70 tx=0x7f81f4006df0).stop 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 -- 172.21.15.50:0/1247771203 shutdown_connections 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 --2- 172.21.15.50:0/1247771203 >> v2:172.21.15.50:3300/0 conn(0x7f820005cc50 0x7f820005fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8200139720 0x7f820005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 --2- 172.21.15.50:0/1247771203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f820005d7d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 -- 172.21.15.50:0/1247771203 >> 172.21.15.50:0/1247771203 conn(0x7f82000669d0 msgr2=0x7f82000a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 -- 172.21.15.50:0/1247771203 shutdown_connections 2022-05-02T09:39:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.579+0000 7f82049fe700 1 -- 172.21.15.50:0/1247771203 wait complete. 2022-05-02T09:39:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.580+0000 7f82049fe700 1 Processor -- start 2022-05-02T09:39:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 -- start start 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 0x7f82000a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f8200145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200132940 con 0x7f8200139720 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000a1a90 con 0x7f8200139b00 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.581+0000 7f82049fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82001326d0 con 0x7f820005cc50 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 0x7f82000a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49526/0 (socket says 172.21.15.50:49526) 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 -- 172.21.15.50:0/455270310 learned_addr learned my addr 172.21.15.50:0/455270310 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81ff59e700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f8200145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 -- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 msgr2=0x7f8200145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f8200145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 -- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 msgr2=0x7f82000a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 0x7f82000a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 -- 172.21.15.50:0/455270310 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f000b180 con 0x7f820005cc50 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81ff59e700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f8200145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fe59c700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 0x7f82000a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.582+0000 7f81fed9d700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f81f000c000 tx=0x7f81f0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.583+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f000c890 con 0x7f820005cc50 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.583+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000c9f0 con 0x7f820005cc50 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.583+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f400b180 con 0x7f820005cc50 2022-05-02T09:39:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.583+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f000cd50 con 0x7f820005cc50 2022-05-02T09:39:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.583+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82000a0630 con 0x7f820005cc50 2022-05-02T09:39:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.584+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820005d100 con 0x7f820005cc50 2022-05-02T09:39:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.584+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f81f001c460 con 0x7f820005cc50 2022-05-02T09:39:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.585+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f81f004aa20 con 0x7f820005cc50 2022-05-02T09:39:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.588+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f81f0033480 con 0x7f820005cc50 2022-05-02T09:39:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:14.745+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f82000a26d0 con 0x7f820005cc50 2022-05-02T09:39:15.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.336+0000 7f81effff700 1 -- 172.21.15.50:0/455270310 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f81f0033070 con 0x7f820005cc50 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 >> v1:172.21.15.50:6800/30011 conn(0x7f81dc038940 legacy=0x7f81dc03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 msgr2=0x7f82000a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f81f000c000 tx=0x7f81f0006df0).stop 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 shutdown_connections 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f820005cc50 0x7f82000a0cd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8200139b00 0x7f8200145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 --2- 172.21.15.50:0/455270310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8200139720 0x7f82000a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 >> 172.21.15.50:0/455270310 conn(0x7f82000669d0 msgr2=0x7f82000aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 shutdown_connections 2022-05-02T09:39:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.338+0000 7f82049fe700 1 -- 172.21.15.50:0/455270310 wait complete. 2022-05-02T09:39:15.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.572+0000 7faebb59e700 1 Processor -- start 2022-05-02T09:39:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.572+0000 7faebb59e700 1 -- start start 2022-05-02T09:39:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebb59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc139010 con 0x7faebc05cc50 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1392d0 con 0x7faebc139720 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebb59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0a7c50 con 0x7faebc139b00 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faeb9d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.573+0000 7faebad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faebc05cc50 0x7faebc05fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52158/0 (socket says 172.21.15.50:52158) 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faebad9d700 1 -- 172.21.15.50:0/3893944096 learned_addr learned my addr 172.21.15.50:0/3893944096 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeba59c700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb959a700 1 -- 172.21.15.50:0/3893944096 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477632093 0 0) 0x7faebc139010 con 0x7faebc05cc50 2022-05-02T09:39:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb9d9b700 1 -- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 msgr2=0x7faebc05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb9d9b700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb9d9b700 1 -- 172.21.15.50:0/3893944096 >> v1:172.21.15.50:6789/0 conn(0x7faebc05cc50 legacy=0x7faebc05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb9d9b700 1 -- 172.21.15.50:0/3893944096 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0a95d0 con 0x7faebc139b00 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeba59c700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.574+0000 7faeb9d9b700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc05d7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7faeb0002f70 tx=0x7faeb0006df0).ready entity=mon.2 client_cookie=47278bba4defe159 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faeb959a700 1 -- 172.21.15.50:0/3893944096 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeb000d570 con 0x7faebc139b00 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faeb959a700 1 -- 172.21.15.50:0/3893944096 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0000e90 con 0x7faebc139b00 2022-05-02T09:39:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faeb959a700 1 -- 172.21.15.50:0/3893944096 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeb000d8c0 con 0x7faebc139b00 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 -- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 msgr2=0x7faebc05d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc05d7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7faeb0002f70 tx=0x7faeb0006df0).stop 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 -- 172.21.15.50:0/3893944096 shutdown_connections 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 --2- 172.21.15.50:0/3893944096 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc05d7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 -- 172.21.15.50:0/3893944096 >> 172.21.15.50:0/3893944096 conn(0x7faebc0669d0 msgr2=0x7faebc0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 -- 172.21.15.50:0/3893944096 shutdown_connections 2022-05-02T09:39:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.575+0000 7faebb59e700 1 -- 172.21.15.50:0/3893944096 wait complete. 2022-05-02T09:39:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.576+0000 7faebb59e700 1 Processor -- start 2022-05-02T09:39:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 -- start start 2022-05-02T09:39:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc1486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0a1c60 con 0x7faebc05cc50 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0a1760 con 0x7faebc139720 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.577+0000 7faebb59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1362a0 con 0x7faebc139b00 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35632/0 (socket says 172.21.15.50:35632) 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 -- 172.21.15.50:0/1527788 learned_addr learned my addr 172.21.15.50:0/1527788 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faebad9d700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc1486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeb9d9b700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 -- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 msgr2=0x7faebc1486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc1486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 -- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 msgr2=0x7faebc132340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc132340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.578+0000 7faeba59c700 1 -- 172.21.15.50:0/1527788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac00b180 con 0x7faebc05cc50 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faeba59c700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faeac00c000 tx=0x7faeac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac00c5f0 con 0x7faebc05cc50 2022-05-02T09:39:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00c750 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb000b180 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac00cab0 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.579+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc0a64c0 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.580+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc057990 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.580+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7faeac00cc10 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.581+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faeac04a7e0 con 0x7faebc05cc50 2022-05-02T09:39:15.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.584+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faeac033350 con 0x7faebc05cc50 2022-05-02T09:39:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.739+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faebc0a0950 con 0x7faebc05cc50 2022-05-02T09:39:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.739+0000 7faeab7fe700 1 -- 172.21.15.50:0/1527788 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2322 (secure 0 0 0) 0x7faeac032f40 con 0x7faebc05cc50 2022-05-02T09:39:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:15.742 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:15.328375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 >> v1:172.21.15.50:6800/30011 conn(0x7fae98038940 legacy=0x7fae9803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 msgr2=0x7faebc135cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faeac00c000 tx=0x7faeac006df0).stop 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 shutdown_connections 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faebc139b00 0x7faebc1486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faebc05cc50 0x7faebc135cc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 --2- 172.21.15.50:0/1527788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faebc139720 0x7faebc132340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 >> 172.21.15.50:0/1527788 conn(0x7faebc0669d0 msgr2=0x7faebc06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.741+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 shutdown_connections 2022-05-02T09:39:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.742+0000 7faebb59e700 1 -- 172.21.15.50:0/1527788 wait complete. 2022-05-02T09:39:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2022-05-02T09:39:15.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:15.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.972+0000 7f26931ff700 1 Processor -- start 2022-05-02T09:39:15.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.972+0000 7f26931ff700 1 -- start start 2022-05-02T09:39:15.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.973+0000 7f26931ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f268c05d8d0 0x7f268c05cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.973+0000 7f26931ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c140a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.973+0000 7f26931ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c139450 con 0x7f268c139e80 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.973+0000 7f26931ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c139710 con 0x7f268c05d8d0 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.973+0000 7f26931ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c05bd60 con 0x7f268c13e660 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f268c05d8d0 0x7f268c05cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f268c05d8d0 0x7f268c05cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35634/0 (socket says 172.21.15.50:35634) 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 -- 172.21.15.50:0/831305030 learned_addr learned my addr 172.21.15.50:0/831305030 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f269179c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 -- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 msgr2=0x7f268c140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 --2- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 -- 172.21.15.50:0/831305030 >> v1:172.21.15.50:6789/0 conn(0x7f268c139e80 legacy=0x7f268c0a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.974+0000 7f268bfff700 1 -- 172.21.15.50:0/831305030 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0abf50 con 0x7f268c05d8d0 2022-05-02T09:39:15.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f268bfff700 1 --2- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c05cde0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2678002f70 tx=0x7f2678006eb0).ready entity=mon.0 client_cookie=fd885e7b91c89a0b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:15.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f268b7fe700 1 -- 172.21.15.50:0/831305030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f267800d570 con 0x7f268c05d8d0 2022-05-02T09:39:15.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f268b7fe700 1 -- 172.21.15.50:0/831305030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2678000e90 con 0x7f268c05d8d0 2022-05-02T09:39:15.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f268b7fe700 1 -- 172.21.15.50:0/831305030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f267800d900 con 0x7f268c05d8d0 2022-05-02T09:39:15.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f26931ff700 1 -- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 msgr2=0x7f268c05cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.975+0000 7f26931ff700 1 --2- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c05cde0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2678002f70 tx=0x7f2678006eb0).stop 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 -- 172.21.15.50:0/831305030 shutdown_connections 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 --2- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 --2- 172.21.15.50:0/831305030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c05cde0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 -- 172.21.15.50:0/831305030 >> 172.21.15.50:0/831305030 conn(0x7f268c066b60 msgr2=0x7f268c0a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 -- 172.21.15.50:0/831305030 shutdown_connections 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.976+0000 7f26931ff700 1 -- 172.21.15.50:0/831305030 wait complete. 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.977+0000 7f26931ff700 1 Processor -- start 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.977+0000 7f26931ff700 1 -- start start 2022-05-02T09:39:15.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c12b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f268c139e80 0x7f268c12b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c12bf00 con 0x7f268c05d8d0 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0a3340 con 0x7f268c13e660 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f26931ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0a2b70 con 0x7f268c139e80 2022-05-02T09:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f269179c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f2690f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c12b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f268bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f268c139e80 0x7f268c12b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f269179c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50216/0 (socket says 172.21.15.50:50216) 2022-05-02T09:39:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.978+0000 7f269179c700 1 -- 172.21.15.50:0/460433340 learned_addr learned my addr 172.21.15.50:0/460433340 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 -- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f268c139e80 msgr2=0x7f268c12b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f268c139e80 0x7f268c12b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 -- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 msgr2=0x7f268c12b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c12b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 -- 172.21.15.50:0/460433340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267800b1e0 con 0x7f268c13e660 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f269179c700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f268400c000 tx=0x7f26840091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2684012600 con 0x7f268c13e660 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2684012760 con 0x7f268c13e660 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2684012ac0 con 0x7f268c13e660 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c0a3f30 con 0x7f268c13e660 2022-05-02T09:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.979+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c0a2390 con 0x7f268c13e660 2022-05-02T09:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.980+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f2684022070 con 0x7f268c13e660 2022-05-02T09:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.981+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c0a07f0 con 0x7f268c13e660 2022-05-02T09:39:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.981+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f268404aa10 con 0x7f268c13e660 2022-05-02T09:39:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:15.984+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f268402fa40 con 0x7f268c13e660 2022-05-02T09:39:16.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.110+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f268c0a1dd0 con 0x7f268c13e660 2022-05-02T09:39:16.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.111+0000 7f2689ffb700 1 -- 172.21.15.50:0/460433340 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f2684033060 con 0x7f268c13e660 2022-05-02T09:39:16.113 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:12.304403+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:16.115 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.112+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 >> v1:172.21.15.50:6800/30011 conn(0x7f266c0389d0 legacy=0x7f266c03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.112+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 msgr2=0x7f268c12ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.112+0000 7f26931ff700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f268400c000 tx=0x7f26840091d0).stop 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 shutdown_connections 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f268c13e660 0x7f268c12ba10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268c05d8d0 0x7f268c12b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 --2- 172.21.15.50:0/460433340 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f268c139e80 0x7f268c12b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 >> 172.21.15.50:0/460433340 conn(0x7f268c066b60 msgr2=0x7f268c0ac290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 shutdown_connections 2022-05-02T09:39:16.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.113+0000 7f26931ff700 1 -- 172.21.15.50:0/460433340 wait complete. 2022-05-02T09:39:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-05-02T09:39:16.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:39:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.344+0000 7fbfcd59d700 1 Processor -- start 2022-05-02T09:39:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.344+0000 7fbfcd59d700 1 -- start start 2022-05-02T09:39:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80a7270 con 0x7fbfc8136140 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8094760 con 0x7fbfc8095430 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.345+0000 7fbfcd59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8135ea0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfccd9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50218/0 (socket says 172.21.15.50:50218) 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 -- 172.21.15.50:0/1849912564 learned_addr learned my addr 172.21.15.50:0/1849912564 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfccd9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35638/0 (socket says 172.21.15.50:35638) 2022-05-02T09:39:16.350 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49534/0 (socket says 172.21.15.50:49534) 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 -- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 msgr2=0x7fbfc81327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 -- 172.21.15.50:0/1849912564 >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 msgr2=0x7fbfc81365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/1849912564 >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc77fe700 1 -- 172.21.15.50:0/1849912564 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc81335a0 con 0x7fbfc8095430 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfc7fff700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.346+0000 7fbfccd9c700 1 --2- 172.21.15.50:0/1849912564 >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbfbc002f70 tx=0x7fbfbc006eb0).ready entity=mon.1 client_cookie=ad9fb86beb8d5281 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfc6ffd700 1 -- 172.21.15.50:0/1849912564 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc00d570 con 0x7fbfc8095430 2022-05-02T09:39:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfc6ffd700 1 -- 172.21.15.50:0/1849912564 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc000e90 con 0x7fbfc8095430 2022-05-02T09:39:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfc6ffd700 1 -- 172.21.15.50:0/1849912564 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc00d900 con 0x7fbfc8095430 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfcd59d700 1 -- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 msgr2=0x7fbfc81330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.347+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbfbc002f70 tx=0x7fbfbc006eb0).stop 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 -- 172.21.15.50:0/1849912564 shutdown_connections 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/1849912564 >> v2:172.21.15.50:3300/0 conn(0x7fbfc8136140 0x7fbfc81365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/1849912564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8095430 0x7fbfc81330b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 -- 172.21.15.50:0/1849912564 >> 172.21.15.50:0/1849912564 conn(0x7fbfc805b8a0 msgr2=0x7fbfc805bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 -- 172.21.15.50:0/1849912564 shutdown_connections 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.348+0000 7fbfcd59d700 1 -- 172.21.15.50:0/1849912564 wait complete. 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.349+0000 7fbfcd59d700 1 Processor -- start 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.349+0000 7fbfcd59d700 1 -- start start 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8136140 0x7fbfc8148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc813b120 con 0x7fbfc8095430 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8139300 con 0x7fbfc8136140 2022-05-02T09:39:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfcd59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81395a0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35640/0 (socket says 172.21.15.50:35640) 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfc7fff700 1 -- 172.21.15.50:0/3098065968 learned_addr learned my addr 172.21.15.50:0/3098065968 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.350+0000 7fbfccd9c700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8136140 0x7fbfc8148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 -- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8136140 msgr2=0x7fbfc8148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8136140 0x7fbfc8148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 -- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 msgr2=0x7fbfc8061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 -- 172.21.15.50:0/3098065968 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb800d410 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc7fff700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc77fe700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81488e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbfbc002f70 tx=0x7fbfbc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc00dea0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc006b40 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0009470 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.351+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc011e20 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.352+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc00b1e0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.353+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fbfbc01a040 con 0x7fbfc80a6e90 2022-05-02T09:39:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.353+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbfbc04afa0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.353+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc806c070 con 0x7fbfc80a6e90 2022-05-02T09:39:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.357+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbfbc0082b0 con 0x7fbfc80a6e90 2022-05-02T09:39:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.479+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 --> v1:172.21.15.50:6800/30011 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfc8132c00 con 0x7fbfa8038940 2022-05-02T09:39:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.488+0000 7fbfc57fa700 1 -- 172.21.15.50:0/3098065968 <== mgr.4101 v1:172.21.15.50:6800/30011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246998 (unknown 2965378022 0 1539307960) 0x7fbfc8132c00 con 0x7fbfa8038940 2022-05-02T09:39:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 >> v1:172.21.15.50:6800/30011 conn(0x7fbfa8038940 legacy=0x7fbfa803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 msgr2=0x7fbfc81488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81488e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbfbc002f70 tx=0x7fbfbc015000).stop 2022-05-02T09:39:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 shutdown_connections 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbfc8136140 0x7fbfc8148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8095430 0x7fbfc8061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 --2- 172.21.15.50:0/3098065968 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbfc80a6e90 0x7fbfc81488e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 >> 172.21.15.50:0/3098065968 conn(0x7fbfc805b8a0 msgr2=0x7fbfc80a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 shutdown_connections 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.492+0000 7fbfcd59d700 1 -- 172.21.15.50:0/3098065968 wait complete. 2022-05-02T09:39:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:39:16.517 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2022-05-02T09:39:16.328859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":219350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001143"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355153+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:11.355153+0000","last_peered":"2022-05-02T09:39:11.355153+0000","last_clean":"2022-05-02T09:39:11.355153+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:11.355153+0000","last_undegraded":"2022-05-02T09:39:11.355153+0000","last_fullsized":"2022-05-02T09:39:11.355153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368500+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:11.368500+0000","last_peered":"2022-05-02T09:39:11.368500+0000","last_clean":"2022-05-02T09:39:11.368500+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:11.368500+0000","last_undegraded":"2022-05-02T09:39:11.368500+0000","last_fullsized":"2022-05-02T09:39:11.368500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369629+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:11.369629+0000","last_peered":"2022-05-02T09:39:11.369629+0000","last_clean":"2022-05-02T09:39:11.369629+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:11.369629+0000","last_undegraded":"2022-05-02T09:39:11.369629+0000","last_fullsized":"2022-05-02T09:39:11.369629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365329+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:11.365329+0000","last_peered":"2022-05-02T09:39:11.365329+0000","last_clean":"2022-05-02T09:39:11.365329+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:11.365329+0000","last_undegraded":"2022-05-02T09:39:11.365329+0000","last_fullsized":"2022-05-02T09:39:11.365329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.352892+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:11.352892+0000","last_peered":"2022-05-02T09:39:11.352892+0000","last_clean":"2022-05-02T09:39:11.352892+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:11.352892+0000","last_undegraded":"2022-05-02T09:39:11.352892+0000","last_fullsized":"2022-05-02T09:39:11.352892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336375+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:11.336375+0000","last_peered":"2022-05-02T09:39:11.336375+0000","last_clean":"2022-05-02T09:39:11.336375+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:11.336375+0000","last_undegraded":"2022-05-02T09:39:11.336375+0000","last_fullsized":"2022-05-02T09:39:11.336375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360099+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:11.360099+0000","last_peered":"2022-05-02T09:39:11.360099+0000","last_clean":"2022-05-02T09:39:11.360099+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:11.360099+0000","last_undegraded":"2022-05-02T09:39:11.360099+0000","last_fullsized":"2022-05-02T09:39:11.360099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369652+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:11.369652+0000","last_peered":"2022-05-02T09:39:11.369652+0000","last_clean":"2022-05-02T09:39:11.369652+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:11.369652+0000","last_undegraded":"2022-05-02T09:39:11.369652+0000","last_fullsized":"2022-05-02T09:39:11.369652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357350+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:11.357350+0000","last_peered":"2022-05-02T09:39:11.357350+0000","last_clean":"2022-05-02T09:39:11.357350+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:11.357350+0000","last_undegraded":"2022-05-02T09:39:11.357350+0000","last_fullsized":"2022-05-02T09:39:11.357350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367445+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:11.367445+0000","last_peered":"2022-05-02T09:39:11.367445+0000","last_clean":"2022-05-02T09:39:11.367445+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:11.367445+0000","last_undegraded":"2022-05-02T09:39:11.367445+0000","last_fullsized":"2022-05-02T09:39:11.367445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368889+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:11.368889+0000","last_peered":"2022-05-02T09:39:11.368889+0000","last_clean":"2022-05-02T09:39:11.368889+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:11.368889+0000","last_undegraded":"2022-05-02T09:39:11.368889+0000","last_fullsized":"2022-05-02T09:39:11.368889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357571+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:11.357571+0000","last_peered":"2022-05-02T09:39:11.357571+0000","last_clean":"2022-05-02T09:39:11.357571+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:11.357571+0000","last_undegraded":"2022-05-02T09:39:11.357571+0000","last_fullsized":"2022-05-02T09:39:11.357571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355213+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:11.355213+0000","last_peered":"2022-05-02T09:39:11.355213+0000","last_clean":"2022-05-02T09:39:11.355213+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:11.355213+0000","last_undegraded":"2022-05-02T09:39:11.355213+0000","last_fullsized":"2022-05-02T09:39:11.355213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360530+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:11.360530+0000","last_peered":"2022-05-02T09:39:11.360530+0000","last_clean":"2022-05-02T09:39:11.360530+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:11.360530+0000","last_undegraded":"2022-05-02T09:39:11.360530+0000","last_fullsized":"2022-05-02T09:39:11.360530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365433+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:11.365433+0000","last_peered":"2022-05-02T09:39:11.365433+0000","last_clean":"2022-05-02T09:39:11.365433+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:11.365433+0000","last_undegraded":"2022-05-02T09:39:11.365433+0000","last_fullsized":"2022-05-02T09:39:11.365433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354550+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:11.354550+0000","last_peered":"2022-05-02T09:39:11.354550+0000","last_clean":"2022-05-02T09:39:11.354550+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:11.354550+0000","last_undegraded":"2022-05-02T09:39:11.354550+0000","last_fullsized":"2022-05-02T09:39:11.354550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357327+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:11.357327+0000","last_peered":"2022-05-02T09:39:11.357327+0000","last_clean":"2022-05-02T09:39:11.357327+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:11.357327+0000","last_undegraded":"2022-05-02T09:39:11.357327+0000","last_fullsized":"2022-05-02T09:39:11.357327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365430+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:11.365430+0000","last_peered":"2022-05-02T09:39:11.365430+0000","last_clean":"2022-05-02T09:39:11.365430+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:11.365430+0000","last_undegraded":"2022-05-02T09:39:11.365430+0000","last_fullsized":"2022-05-02T09:39:11.365430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.356788+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:11.356788+0000","last_peered":"2022-05-02T09:39:11.356788+0000","last_clean":"2022-05-02T09:39:11.356788+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:11.356788+0000","last_undegraded":"2022-05-02T09:39:11.356788+0000","last_fullsized":"2022-05-02T09:39:11.356788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367056+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:11.367056+0000","last_peered":"2022-05-02T09:39:11.367056+0000","last_clean":"2022-05-02T09:39:11.367056+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:11.367056+0000","last_undegraded":"2022-05-02T09:39:11.367056+0000","last_fullsized":"2022-05-02T09:39:11.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366274+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:11.366274+0000","last_peered":"2022-05-02T09:39:11.366274+0000","last_clean":"2022-05-02T09:39:11.366274+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:11.366274+0000","last_undegraded":"2022-05-02T09:39:11.366274+0000","last_fullsized":"2022-05-02T09:39:11.366274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365262+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:11.365262+0000","last_peered":"2022-05-02T09:39:11.365262+0000","last_clean":"2022-05-02T09:39:11.365262+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:11.365262+0000","last_undegraded":"2022-05-02T09:39:11.365262+0000","last_fullsized":"2022-05-02T09:39:11.365262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360079+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:11.360079+0000","last_peered":"2022-05-02T09:39:11.360079+0000","last_clean":"2022-05-02T09:39:11.360079+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:11.360079+0000","last_undegraded":"2022-05-02T09:39:11.360079+0000","last_fullsized":"2022-05-02T09:39:11.360079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360396+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:11.360396+0000","last_peered":"2022-05-02T09:39:11.360396+0000","last_clean":"2022-05-02T09:39:11.360396+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:11.360396+0000","last_undegraded":"2022-05-02T09:39:11.360396+0000","last_fullsized":"2022-05-02T09:39:11.360396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361409+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:11.361409+0000","last_peered":"2022-05-02T09:39:11.361409+0000","last_clean":"2022-05-02T09:39:11.361409+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:11.361409+0000","last_undegraded":"2022-05-02T09:39:11.361409+0000","last_fullsized":"2022-05-02T09:39:11.361409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367015+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:11.367015+0000","last_peered":"2022-05-02T09:39:11.367015+0000","last_clean":"2022-05-02T09:39:11.367015+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:11.367015+0000","last_undegraded":"2022-05-02T09:39:11.367015+0000","last_fullsized":"2022-05-02T09:39:11.367015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360228+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:11.360228+0000","last_peered":"2022-05-02T09:39:11.360228+0000","last_clean":"2022-05-02T09:39:11.360228+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:11.360228+0000","last_undegraded":"2022-05-02T09:39:11.360228+0000","last_fullsized":"2022-05-02T09:39:11.360228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360570+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:11.360570+0000","last_peered":"2022-05-02T09:39:11.360570+0000","last_clean":"2022-05-02T09:39:11.360570+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:11.360570+0000","last_undegraded":"2022-05-02T09:39:11.360570+0000","last_fullsized":"2022-05-02T09:39:11.360570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374260+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:11.374260+0000","last_peered":"2022-05-02T09:39:11.374260+0000","last_clean":"2022-05-02T09:39:11.374260+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:11.374260+0000","last_undegraded":"2022-05-02T09:39:11.374260+0000","last_fullsized":"2022-05-02T09:39:11.374260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312943+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:11.312943+0000","last_peered":"2022-05-02T09:39:11.312943+0000","last_clean":"2022-05-02T09:39:11.312943+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:11.312943+0000","last_undegraded":"2022-05-02T09:39:11.312943+0000","last_fullsized":"2022-05-02T09:39:11.312943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369975+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:11.369975+0000","last_peered":"2022-05-02T09:39:11.369975+0000","last_clean":"2022-05-02T09:39:11.369975+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:11.369975+0000","last_undegraded":"2022-05-02T09:39:11.369975+0000","last_fullsized":"2022-05-02T09:39:11.369975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175205+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:13.175205+0000","last_peered":"2022-05-02T09:39:13.175205+0000","last_clean":"2022-05-02T09:39:13.175205+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:13.175205+0000","last_undegraded":"2022-05-02T09:39:13.175205+0000","last_fullsized":"2022-05-02T09:39:13.175205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374280+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:11.374280+0000","last_peered":"2022-05-02T09:39:11.374280+0000","last_clean":"2022-05-02T09:39:11.374280+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:11.374280+0000","last_undegraded":"2022-05-02T09:39:11.374280+0000","last_fullsized":"2022-05-02T09:39:11.374280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349121+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:39:14.349121+0000","last_peered":"2022-05-02T09:39:14.349121+0000","last_clean":"2022-05-02T09:39:14.349121+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:39:14.349121+0000","last_undegraded":"2022-05-02T09:39:14.349121+0000","last_fullsized":"2022-05-02T09:39:14.349121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.342612+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:11.342612+0000","last_peered":"2022-05-02T09:39:11.342612+0000","last_clean":"2022-05-02T09:39:11.342612+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:11.342612+0000","last_undegraded":"2022-05-02T09:39:11.342612+0000","last_fullsized":"2022-05-02T09:39:11.342612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:14.347064+0000","last_peered":"2022-05-02T09:39:14.347064+0000","last_clean":"2022-05-02T09:39:14.347064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:14.347064+0000","last_undegraded":"2022-05-02T09:39:14.347064+0000","last_fullsized":"2022-05-02T09:39:14.347064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360056+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:11.360056+0000","last_peered":"2022-05-02T09:39:11.360056+0000","last_clean":"2022-05-02T09:39:11.360056+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:11.360056+0000","last_undegraded":"2022-05-02T09:39:11.360056+0000","last_fullsized":"2022-05-02T09:39:11.360056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312107+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:12.312107+0000","last_peered":"2022-05-02T09:39:12.312107+0000","last_clean":"2022-05-02T09:39:12.312107+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:12.312107+0000","last_undegraded":"2022-05-02T09:39:12.312107+0000","last_fullsized":"2022-05-02T09:39:12.312107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366331+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:11.366331+0000","last_peered":"2022-05-02T09:39:11.366331+0000","last_clean":"2022-05-02T09:39:11.366331+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:11.366331+0000","last_undegraded":"2022-05-02T09:39:11.366331+0000","last_fullsized":"2022-05-02T09:39:11.366331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346844+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:39:14.346844+0000","last_peered":"2022-05-02T09:39:14.346844+0000","last_clean":"2022-05-02T09:39:14.346844+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:39:14.346844+0000","last_undegraded":"2022-05-02T09:39:14.346844+0000","last_fullsized":"2022-05-02T09:39:14.346844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355173+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:11.355173+0000","last_peered":"2022-05-02T09:39:11.355173+0000","last_clean":"2022-05-02T09:39:11.355173+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:11.355173+0000","last_undegraded":"2022-05-02T09:39:11.355173+0000","last_fullsized":"2022-05-02T09:39:11.355173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346940+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:14.346940+0000","last_peered":"2022-05-02T09:39:14.346940+0000","last_clean":"2022-05-02T09:39:14.346940+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:14.346940+0000","last_undegraded":"2022-05-02T09:39:14.346940+0000","last_fullsized":"2022-05-02T09:39:14.346940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374300+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:11.374300+0000","last_peered":"2022-05-02T09:39:11.374300+0000","last_clean":"2022-05-02T09:39:11.374300+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:11.374300+0000","last_undegraded":"2022-05-02T09:39:11.374300+0000","last_fullsized":"2022-05-02T09:39:11.374300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347966+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:14.347966+0000","last_peered":"2022-05-02T09:39:14.347966+0000","last_clean":"2022-05-02T09:39:14.347966+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:14.347966+0000","last_undegraded":"2022-05-02T09:39:14.347966+0000","last_fullsized":"2022-05-02T09:39:14.347966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360201+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:11.360201+0000","last_peered":"2022-05-02T09:39:11.360201+0000","last_clean":"2022-05-02T09:39:11.360201+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:11.360201+0000","last_undegraded":"2022-05-02T09:39:11.360201+0000","last_fullsized":"2022-05-02T09:39:11.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313705+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:11.313705+0000","last_peered":"2022-05-02T09:39:11.313705+0000","last_clean":"2022-05-02T09:39:11.313705+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:11.313705+0000","last_undegraded":"2022-05-02T09:39:11.313705+0000","last_fullsized":"2022-05-02T09:39:11.313705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357485+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:11.357485+0000","last_peered":"2022-05-02T09:39:11.357485+0000","last_clean":"2022-05-02T09:39:11.357485+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:11.357485+0000","last_undegraded":"2022-05-02T09:39:11.357485+0000","last_fullsized":"2022-05-02T09:39:11.357485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.344885+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:14.344885+0000","last_peered":"2022-05-02T09:39:14.344885+0000","last_clean":"2022-05-02T09:39:14.344885+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:14.344885+0000","last_undegraded":"2022-05-02T09:39:14.344885+0000","last_fullsized":"2022-05-02T09:39:14.344885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374217+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:11.374217+0000","last_peered":"2022-05-02T09:39:11.374217+0000","last_clean":"2022-05-02T09:39:11.374217+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:11.374217+0000","last_undegraded":"2022-05-02T09:39:11.374217+0000","last_fullsized":"2022-05-02T09:39:11.374217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368927+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:11.368927+0000","last_peered":"2022-05-02T09:39:11.368927+0000","last_clean":"2022-05-02T09:39:11.368927+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:11.368927+0000","last_undegraded":"2022-05-02T09:39:11.368927+0000","last_fullsized":"2022-05-02T09:39:11.368927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.373265+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:11.373265+0000","last_peered":"2022-05-02T09:39:11.373265+0000","last_clean":"2022-05-02T09:39:11.373265+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:11.373265+0000","last_undegraded":"2022-05-02T09:39:11.373265+0000","last_fullsized":"2022-05-02T09:39:11.373265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.348885+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:11.348885+0000","last_peered":"2022-05-02T09:39:11.348885+0000","last_clean":"2022-05-02T09:39:11.348885+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:11.348885+0000","last_undegraded":"2022-05-02T09:39:11.348885+0000","last_fullsized":"2022-05-02T09:39:11.348885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360401+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:11.360401+0000","last_peered":"2022-05-02T09:39:11.360401+0000","last_clean":"2022-05-02T09:39:11.360401+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:11.360401+0000","last_undegraded":"2022-05-02T09:39:11.360401+0000","last_fullsized":"2022-05-02T09:39:11.360401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.372713+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:11.372713+0000","last_peered":"2022-05-02T09:39:11.372713+0000","last_clean":"2022-05-02T09:39:11.372713+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:11.372713+0000","last_undegraded":"2022-05-02T09:39:11.372713+0000","last_fullsized":"2022-05-02T09:39:11.372713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357412+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:11.357412+0000","last_peered":"2022-05-02T09:39:11.357412+0000","last_clean":"2022-05-02T09:39:11.357412+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:11.357412+0000","last_undegraded":"2022-05-02T09:39:11.357412+0000","last_fullsized":"2022-05-02T09:39:11.357412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.325992+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:11.325992+0000","last_peered":"2022-05-02T09:39:11.325992+0000","last_clean":"2022-05-02T09:39:11.325992+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:11.325992+0000","last_undegraded":"2022-05-02T09:39:11.325992+0000","last_fullsized":"2022-05-02T09:39:11.325992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365391+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:11.365391+0000","last_peered":"2022-05-02T09:39:11.365391+0000","last_clean":"2022-05-02T09:39:11.365391+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:11.365391+0000","last_undegraded":"2022-05-02T09:39:11.365391+0000","last_fullsized":"2022-05-02T09:39:11.365391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346299+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:14.346299+0000","last_peered":"2022-05-02T09:39:14.346299+0000","last_clean":"2022-05-02T09:39:14.346299+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:14.346299+0000","last_undegraded":"2022-05-02T09:39:14.346299+0000","last_fullsized":"2022-05-02T09:39:14.346299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347440+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:11.347440+0000","last_peered":"2022-05-02T09:39:11.347440+0000","last_clean":"2022-05-02T09:39:11.347440+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:11.347440+0000","last_undegraded":"2022-05-02T09:39:11.347440+0000","last_fullsized":"2022-05-02T09:39:11.347440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313970+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:11.313970+0000","last_peered":"2022-05-02T09:39:11.313970+0000","last_clean":"2022-05-02T09:39:11.313970+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:11.313970+0000","last_undegraded":"2022-05-02T09:39:11.313970+0000","last_fullsized":"2022-05-02T09:39:11.313970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374357+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:11.374357+0000","last_peered":"2022-05-02T09:39:11.374357+0000","last_clean":"2022-05-02T09:39:11.374357+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:11.374357+0000","last_undegraded":"2022-05-02T09:39:11.374357+0000","last_fullsized":"2022-05-02T09:39:11.374357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347002+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:14.347002+0000","last_peered":"2022-05-02T09:39:14.347002+0000","last_clean":"2022-05-02T09:39:14.347002+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:14.347002+0000","last_undegraded":"2022-05-02T09:39:14.347002+0000","last_fullsized":"2022-05-02T09:39:14.347002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357166+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:11.357166+0000","last_peered":"2022-05-02T09:39:11.357166+0000","last_clean":"2022-05-02T09:39:11.357166+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:11.357166+0000","last_undegraded":"2022-05-02T09:39:11.357166+0000","last_fullsized":"2022-05-02T09:39:11.357166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346745+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:14.346745+0000","last_peered":"2022-05-02T09:39:14.346745+0000","last_clean":"2022-05-02T09:39:14.346745+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:14.346745+0000","last_undegraded":"2022-05-02T09:39:14.346745+0000","last_fullsized":"2022-05-02T09:39:14.346745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361382+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:11.361382+0000","last_peered":"2022-05-02T09:39:11.361382+0000","last_clean":"2022-05-02T09:39:11.361382+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:11.361382+0000","last_undegraded":"2022-05-02T09:39:11.361382+0000","last_fullsized":"2022-05-02T09:39:11.361382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.321742+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:11.321742+0000","last_peered":"2022-05-02T09:39:11.321742+0000","last_clean":"2022-05-02T09:39:11.321742+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:11.321742+0000","last_undegraded":"2022-05-02T09:39:11.321742+0000","last_fullsized":"2022-05-02T09:39:11.321742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.309990+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:12.309990+0000","last_peered":"2022-05-02T09:39:12.309990+0000","last_clean":"2022-05-02T09:39:12.309990+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:12.309990+0000","last_undegraded":"2022-05-02T09:39:12.309990+0000","last_fullsized":"2022-05-02T09:39:12.309990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366309+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:11.366309+0000","last_peered":"2022-05-02T09:39:11.366309+0000","last_clean":"2022-05-02T09:39:11.366309+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:11.366309+0000","last_undegraded":"2022-05-02T09:39:11.366309+0000","last_fullsized":"2022-05-02T09:39:11.366309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313812+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:11.313812+0000","last_peered":"2022-05-02T09:39:11.313812+0000","last_clean":"2022-05-02T09:39:11.313812+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:11.313812+0000","last_undegraded":"2022-05-02T09:39:11.313812+0000","last_fullsized":"2022-05-02T09:39:11.313812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346586+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:14.346586+0000","last_peered":"2022-05-02T09:39:14.346586+0000","last_clean":"2022-05-02T09:39:14.346586+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:14.346586+0000","last_undegraded":"2022-05-02T09:39:14.346586+0000","last_fullsized":"2022-05-02T09:39:14.346586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361284+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:11.361284+0000","last_peered":"2022-05-02T09:39:11.361284+0000","last_clean":"2022-05-02T09:39:11.361284+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:11.361284+0000","last_undegraded":"2022-05-02T09:39:11.361284+0000","last_fullsized":"2022-05-02T09:39:11.361284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.316222+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:11.316222+0000","last_peered":"2022-05-02T09:39:11.316222+0000","last_clean":"2022-05-02T09:39:11.316222+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:11.316222+0000","last_undegraded":"2022-05-02T09:39:11.316222+0000","last_fullsized":"2022-05-02T09:39:11.316222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.737867+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:12.737867+0000","last_peered":"2022-05-02T09:39:12.737867+0000","last_clean":"2022-05-02T09:39:12.737867+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:12.737867+0000","last_undegraded":"2022-05-02T09:39:12.737867+0000","last_fullsized":"2022-05-02T09:39:12.737867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367748+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:11.367748+0000","last_peered":"2022-05-02T09:39:11.367748+0000","last_clean":"2022-05-02T09:39:11.367748+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:11.367748+0000","last_undegraded":"2022-05-02T09:39:11.367748+0000","last_fullsized":"2022-05-02T09:39:11.367748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313763+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:11.313763+0000","last_peered":"2022-05-02T09:39:11.313763+0000","last_clean":"2022-05-02T09:39:11.313763+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:11.313763+0000","last_undegraded":"2022-05-02T09:39:11.313763+0000","last_fullsized":"2022-05-02T09:39:11.313763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312314+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:11.312314+0000","last_peered":"2022-05-02T09:39:11.312314+0000","last_clean":"2022-05-02T09:39:11.312314+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:11.312314+0000","last_undegraded":"2022-05-02T09:39:11.312314+0000","last_fullsized":"2022-05-02T09:39:11.312314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313542+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:11.313542+0000","last_peered":"2022-05-02T09:39:11.313542+0000","last_clean":"2022-05-02T09:39:11.313542+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:11.313542+0000","last_undegraded":"2022-05-02T09:39:11.313542+0000","last_fullsized":"2022-05-02T09:39:11.313542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374380+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:11.374380+0000","last_peered":"2022-05-02T09:39:11.374380+0000","last_clean":"2022-05-02T09:39:11.374380+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:11.374380+0000","last_undegraded":"2022-05-02T09:39:11.374380+0000","last_fullsized":"2022-05-02T09:39:11.374380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312941+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:11.312941+0000","last_peered":"2022-05-02T09:39:11.312941+0000","last_clean":"2022-05-02T09:39:11.312941+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:11.312941+0000","last_undegraded":"2022-05-02T09:39:11.312941+0000","last_fullsized":"2022-05-02T09:39:11.312941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.311122+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:12.311122+0000","last_peered":"2022-05-02T09:39:12.311122+0000","last_clean":"2022-05-02T09:39:12.311122+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:12.311122+0000","last_undegraded":"2022-05-02T09:39:12.311122+0000","last_fullsized":"2022-05-02T09:39:12.311122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365451+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:11.365451+0000","last_peered":"2022-05-02T09:39:11.365451+0000","last_clean":"2022-05-02T09:39:11.365451+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:11.365451+0000","last_undegraded":"2022-05-02T09:39:11.365451+0000","last_fullsized":"2022-05-02T09:39:11.365451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.319431+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:11.319431+0000","last_peered":"2022-05-02T09:39:11.319431+0000","last_clean":"2022-05-02T09:39:11.319431+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:11.319431+0000","last_undegraded":"2022-05-02T09:39:11.319431+0000","last_fullsized":"2022-05-02T09:39:11.319431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.317299+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:11.317299+0000","last_peered":"2022-05-02T09:39:11.317299+0000","last_clean":"2022-05-02T09:39:11.317299+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:11.317299+0000","last_undegraded":"2022-05-02T09:39:11.317299+0000","last_fullsized":"2022-05-02T09:39:11.317299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365371+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:11.365371+0000","last_peered":"2022-05-02T09:39:11.365371+0000","last_clean":"2022-05-02T09:39:11.365371+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:11.365371+0000","last_undegraded":"2022-05-02T09:39:11.365371+0000","last_fullsized":"2022-05-02T09:39:11.365371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346024+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:14.346024+0000","last_peered":"2022-05-02T09:39:14.346024+0000","last_clean":"2022-05-02T09:39:14.346024+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:14.346024+0000","last_undegraded":"2022-05-02T09:39:14.346024+0000","last_fullsized":"2022-05-02T09:39:14.346024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.320945+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:11.320945+0000","last_peered":"2022-05-02T09:39:11.320945+0000","last_clean":"2022-05-02T09:39:11.320945+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:11.320945+0000","last_undegraded":"2022-05-02T09:39:11.320945+0000","last_fullsized":"2022-05-02T09:39:11.320945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374239+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:11.374239+0000","last_peered":"2022-05-02T09:39:11.374239+0000","last_clean":"2022-05-02T09:39:11.374239+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:11.374239+0000","last_undegraded":"2022-05-02T09:39:11.374239+0000","last_fullsized":"2022-05-02T09:39:11.374239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.314878+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:11.314878+0000","last_peered":"2022-05-02T09:39:11.314878+0000","last_clean":"2022-05-02T09:39:11.314878+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:11.314878+0000","last_undegraded":"2022-05-02T09:39:11.314878+0000","last_fullsized":"2022-05-02T09:39:11.314878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.333311+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:11.333311+0000","last_peered":"2022-05-02T09:39:11.333311+0000","last_clean":"2022-05-02T09:39:11.333311+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:11.333311+0000","last_undegraded":"2022-05-02T09:39:11.333311+0000","last_fullsized":"2022-05-02T09:39:11.333311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.345426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:11.345426+0000","last_peered":"2022-05-02T09:39:11.345426+0000","last_clean":"2022-05-02T09:39:11.345426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:11.345426+0000","last_undegraded":"2022-05-02T09:39:11.345426+0000","last_fullsized":"2022-05-02T09:39:11.345426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349020+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:14.349020+0000","last_peered":"2022-05-02T09:39:14.349020+0000","last_clean":"2022-05-02T09:39:14.349020+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:14.349020+0000","last_undegraded":"2022-05-02T09:39:14.349020+0000","last_fullsized":"2022-05-02T09:39:14.349020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367944+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:11.367944+0000","last_peered":"2022-05-02T09:39:11.367944+0000","last_clean":"2022-05-02T09:39:11.367944+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:11.367944+0000","last_undegraded":"2022-05-02T09:39:11.367944+0000","last_fullsized":"2022-05-02T09:39:11.367944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361211+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:11.361211+0000","last_peered":"2022-05-02T09:39:11.361211+0000","last_clean":"2022-05-02T09:39:11.361211+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:11.361211+0000","last_undegraded":"2022-05-02T09:39:11.361211+0000","last_fullsized":"2022-05-02T09:39:11.361211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355195+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:11.355195+0000","last_peered":"2022-05-02T09:39:11.355195+0000","last_clean":"2022-05-02T09:39:11.355195+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:11.355195+0000","last_undegraded":"2022-05-02T09:39:11.355195+0000","last_fullsized":"2022-05-02T09:39:11.355195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354864+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:11.354864+0000","last_peered":"2022-05-02T09:39:11.354864+0000","last_clean":"2022-05-02T09:39:11.354864+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:11.354864+0000","last_undegraded":"2022-05-02T09:39:11.354864+0000","last_fullsized":"2022-05-02T09:39:11.354864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357437+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:11.357437+0000","last_peered":"2022-05-02T09:39:11.357437+0000","last_clean":"2022-05-02T09:39:11.357437+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:11.357437+0000","last_undegraded":"2022-05-02T09:39:11.357437+0000","last_fullsized":"2022-05-02T09:39:11.357437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347169+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:11.347169+0000","last_peered":"2022-05-02T09:39:11.347169+0000","last_clean":"2022-05-02T09:39:11.347169+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:11.347169+0000","last_undegraded":"2022-05-02T09:39:11.347169+0000","last_fullsized":"2022-05-02T09:39:11.347169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336363+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:11.336363+0000","last_peered":"2022-05-02T09:39:11.336363+0000","last_clean":"2022-05-02T09:39:11.336363+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:11.336363+0000","last_undegraded":"2022-05-02T09:39:11.336363+0000","last_fullsized":"2022-05-02T09:39:11.336363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369133+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:11.369133+0000","last_peered":"2022-05-02T09:39:11.369133+0000","last_clean":"2022-05-02T09:39:11.369133+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:11.369133+0000","last_undegraded":"2022-05-02T09:39:11.369133+0000","last_fullsized":"2022-05-02T09:39:11.369133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367896+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:11.367896+0000","last_peered":"2022-05-02T09:39:11.367896+0000","last_clean":"2022-05-02T09:39:11.367896+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:11.367896+0000","last_undegraded":"2022-05-02T09:39:11.367896+0000","last_fullsized":"2022-05-02T09:39:11.367896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360368+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:11.360368+0000","last_peered":"2022-05-02T09:39:11.360368+0000","last_clean":"2022-05-02T09:39:11.360368+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:11.360368+0000","last_undegraded":"2022-05-02T09:39:11.360368+0000","last_fullsized":"2022-05-02T09:39:11.360368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.346985+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:11.346985+0000","last_peered":"2022-05-02T09:39:11.346985+0000","last_clean":"2022-05-02T09:39:11.346985+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:11.346985+0000","last_undegraded":"2022-05-02T09:39:11.346985+0000","last_fullsized":"2022-05-02T09:39:11.346985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347483+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:11.347483+0000","last_peered":"2022-05-02T09:39:11.347483+0000","last_clean":"2022-05-02T09:39:11.347483+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:11.347483+0000","last_undegraded":"2022-05-02T09:39:11.347483+0000","last_fullsized":"2022-05-02T09:39:11.347483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374132+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:11.374132+0000","last_peered":"2022-05-02T09:39:11.374132+0000","last_clean":"2022-05-02T09:39:11.374132+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:11.374132+0000","last_undegraded":"2022-05-02T09:39:11.374132+0000","last_fullsized":"2022-05-02T09:39:11.374132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368847+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:11.368847+0000","last_peered":"2022-05-02T09:39:11.368847+0000","last_clean":"2022-05-02T09:39:11.368847+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:11.368847+0000","last_undegraded":"2022-05-02T09:39:11.368847+0000","last_fullsized":"2022-05-02T09:39:11.368847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":56079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}]}} 2022-05-02T09:39:16.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:39:16.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.759+0000 7f0d7e59d700 1 Processor -- start 2022-05-02T09:39:16.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.759+0000 7f0d7e59d700 1 -- start start 2022-05-02T09:39:16.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7e59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d78139720 0x7f0d7805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7e59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7e59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d78139010 con 0x7f0d7805cc50 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7e59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d781392d0 con 0x7f0d78139720 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7e59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780a7c50 con 0x7f0d78139b00 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7cd9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7d59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d78139720 0x7f0d7805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7cd9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50222/0 (socket says 172.21.15.50:50222) 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7d59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d78139720 0x7f0d7805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35642/0 (socket says 172.21.15.50:35642) 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7cd9a700 1 -- 172.21.15.50:0/3802781919 learned_addr learned my addr 172.21.15.50:0/3802781919 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.760+0000 7f0d7dd9c700 1 --1- 172.21.15.50:0/3802781919 >> v1:172.21.15.50:6789/0 conn(0x7f0d7805cc50 0x7f0d7805fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52162/0 (socket says 172.21.15.50:52162) 2022-05-02T09:39:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7d59b700 1 -- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 msgr2=0x7f0d7805d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7d59b700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7d59b700 1 -- 172.21.15.50:0/3802781919 >> v1:172.21.15.50:6789/0 conn(0x7f0d7805cc50 legacy=0x7f0d7805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7d59b700 1 -- 172.21.15.50:0/3802781919 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780a95d0 con 0x7f0d78139720 2022-05-02T09:39:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7cd9a700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.761+0000 7f0d7d59b700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78139720 0x7f0d7805b8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0d74002f70 tx=0x7f0d74006df0).ready entity=mon.0 client_cookie=f413987194aff1ce server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:16.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d67fff700 1 -- 172.21.15.50:0/3802781919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d7400d570 con 0x7f0d78139720 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d67fff700 1 -- 172.21.15.50:0/3802781919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74000e90 con 0x7f0d78139720 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d67fff700 1 -- 172.21.15.50:0/3802781919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d7400d8c0 con 0x7f0d78139720 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78139720 msgr2=0x7f0d7805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78139720 0x7f0d7805b8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0d74002f70 tx=0x7f0d74006df0).stop 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3802781919 shutdown_connections 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78139720 0x7f0d7805b8a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3802781919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d7805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3802781919 >> 172.21.15.50:0/3802781919 conn(0x7f0d780669d0 msgr2=0x7f0d780a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:16.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3802781919 shutdown_connections 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.762+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3802781919 wait complete. 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.763+0000 7f0d7e59d700 1 Processor -- start 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 -- start start 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 0x7f0d780a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 0x7f0d78145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d780a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78146360 con 0x7f0d7805cc50 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781460b0 con 0x7f0d78139b00 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.764+0000 7f0d7e59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78146600 con 0x7f0d78139720 2022-05-02T09:39:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7d59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 0x7f0d780a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7dd9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d780a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 0x7f0d78145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7d59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 0x7f0d780a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35644/0 (socket says 172.21.15.50:35644) 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7d59b700 1 -- 172.21.15.50:0/3360741566 learned_addr learned my addr 172.21.15.50:0/3360741566 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7dd9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d780a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50224/0 (socket says 172.21.15.50:50224) 2022-05-02T09:39:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 -- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 msgr2=0x7f0d780a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d780a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 -- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 msgr2=0x7f0d780a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 0x7f0d780a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.765+0000 7f0d7cd9a700 1 -- 172.21.15.50:0/3360741566 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6800b1e0 con 0x7f0d78139720 2022-05-02T09:39:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d7cd9a700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 0x7f0d78145bc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d6800c000 tx=0x7f0d68006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d68012600 con 0x7f0d78139720 2022-05-02T09:39:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68012760 con 0x7f0d78139720 2022-05-02T09:39:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d68012ac0 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7400b180 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.766+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780a3400 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.767+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0d68012c20 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.768+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d78057990 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.768+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0d6804a290 con 0x7f0d78139720 2022-05-02T09:39:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.771+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0d6802f2c0 con 0x7f0d78139720 2022-05-02T09:39:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.892+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 --> v1:172.21.15.50:6800/30011 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d78138200 con 0x7f0d58038a60 2022-05-02T09:39:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.899+0000 7f0d667fc700 1 -- 172.21.15.50:0/3360741566 <== mgr.4101 v1:172.21.15.50:6800/30011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246998 (unknown 2965378022 0 1539307960) 0x7f0d78138200 con 0x7f0d58038a60 2022-05-02T09:39:16.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 >> v1:172.21.15.50:6800/30011 conn(0x7f0d58038a60 legacy=0x7f0d5803af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 msgr2=0x7f0d78145bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 0x7f0d78145bc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d6800c000 tx=0x7f0d68006eb0).stop 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 shutdown_connections 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d78139b00 0x7f0d780a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7805cc50 0x7f0d780a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 --2- 172.21.15.50:0/3360741566 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d78139720 0x7f0d78145bc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 >> 172.21.15.50:0/3360741566 conn(0x7f0d780669d0 msgr2=0x7f0d780ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 shutdown_connections 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:16.902+0000 7f0d7e59d700 1 -- 172.21.15.50:0/3360741566 wait complete. 2022-05-02T09:39:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:39:16.928 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2022-05-02T09:39:16.328859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":219350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001143"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355153+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:11.355153+0000","last_peered":"2022-05-02T09:39:11.355153+0000","last_clean":"2022-05-02T09:39:11.355153+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:11.355153+0000","last_undegraded":"2022-05-02T09:39:11.355153+0000","last_fullsized":"2022-05-02T09:39:11.355153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368500+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:11.368500+0000","last_peered":"2022-05-02T09:39:11.368500+0000","last_clean":"2022-05-02T09:39:11.368500+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:11.368500+0000","last_undegraded":"2022-05-02T09:39:11.368500+0000","last_fullsized":"2022-05-02T09:39:11.368500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369629+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:11.369629+0000","last_peered":"2022-05-02T09:39:11.369629+0000","last_clean":"2022-05-02T09:39:11.369629+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:11.369629+0000","last_undegraded":"2022-05-02T09:39:11.369629+0000","last_fullsized":"2022-05-02T09:39:11.369629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365329+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:11.365329+0000","last_peered":"2022-05-02T09:39:11.365329+0000","last_clean":"2022-05-02T09:39:11.365329+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:11.365329+0000","last_undegraded":"2022-05-02T09:39:11.365329+0000","last_fullsized":"2022-05-02T09:39:11.365329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.352892+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:11.352892+0000","last_peered":"2022-05-02T09:39:11.352892+0000","last_clean":"2022-05-02T09:39:11.352892+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:11.352892+0000","last_undegraded":"2022-05-02T09:39:11.352892+0000","last_fullsized":"2022-05-02T09:39:11.352892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336375+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:11.336375+0000","last_peered":"2022-05-02T09:39:11.336375+0000","last_clean":"2022-05-02T09:39:11.336375+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:11.336375+0000","last_undegraded":"2022-05-02T09:39:11.336375+0000","last_fullsized":"2022-05-02T09:39:11.336375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360099+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:11.360099+0000","last_peered":"2022-05-02T09:39:11.360099+0000","last_clean":"2022-05-02T09:39:11.360099+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:11.360099+0000","last_undegraded":"2022-05-02T09:39:11.360099+0000","last_fullsized":"2022-05-02T09:39:11.360099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369652+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:11.369652+0000","last_peered":"2022-05-02T09:39:11.369652+0000","last_clean":"2022-05-02T09:39:11.369652+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:11.369652+0000","last_undegraded":"2022-05-02T09:39:11.369652+0000","last_fullsized":"2022-05-02T09:39:11.369652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357350+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:11.357350+0000","last_peered":"2022-05-02T09:39:11.357350+0000","last_clean":"2022-05-02T09:39:11.357350+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:11.357350+0000","last_undegraded":"2022-05-02T09:39:11.357350+0000","last_fullsized":"2022-05-02T09:39:11.357350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367445+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:11.367445+0000","last_peered":"2022-05-02T09:39:11.367445+0000","last_clean":"2022-05-02T09:39:11.367445+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:11.367445+0000","last_undegraded":"2022-05-02T09:39:11.367445+0000","last_fullsized":"2022-05-02T09:39:11.367445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368889+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:11.368889+0000","last_peered":"2022-05-02T09:39:11.368889+0000","last_clean":"2022-05-02T09:39:11.368889+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:11.368889+0000","last_undegraded":"2022-05-02T09:39:11.368889+0000","last_fullsized":"2022-05-02T09:39:11.368889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357571+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:11.357571+0000","last_peered":"2022-05-02T09:39:11.357571+0000","last_clean":"2022-05-02T09:39:11.357571+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:11.357571+0000","last_undegraded":"2022-05-02T09:39:11.357571+0000","last_fullsized":"2022-05-02T09:39:11.357571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355213+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:11.355213+0000","last_peered":"2022-05-02T09:39:11.355213+0000","last_clean":"2022-05-02T09:39:11.355213+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:11.355213+0000","last_undegraded":"2022-05-02T09:39:11.355213+0000","last_fullsized":"2022-05-02T09:39:11.355213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360530+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:11.360530+0000","last_peered":"2022-05-02T09:39:11.360530+0000","last_clean":"2022-05-02T09:39:11.360530+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:11.360530+0000","last_undegraded":"2022-05-02T09:39:11.360530+0000","last_fullsized":"2022-05-02T09:39:11.360530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365433+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:11.365433+0000","last_peered":"2022-05-02T09:39:11.365433+0000","last_clean":"2022-05-02T09:39:11.365433+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:11.365433+0000","last_undegraded":"2022-05-02T09:39:11.365433+0000","last_fullsized":"2022-05-02T09:39:11.365433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354550+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:11.354550+0000","last_peered":"2022-05-02T09:39:11.354550+0000","last_clean":"2022-05-02T09:39:11.354550+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:11.354550+0000","last_undegraded":"2022-05-02T09:39:11.354550+0000","last_fullsized":"2022-05-02T09:39:11.354550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357327+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:11.357327+0000","last_peered":"2022-05-02T09:39:11.357327+0000","last_clean":"2022-05-02T09:39:11.357327+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:11.357327+0000","last_undegraded":"2022-05-02T09:39:11.357327+0000","last_fullsized":"2022-05-02T09:39:11.357327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365430+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:11.365430+0000","last_peered":"2022-05-02T09:39:11.365430+0000","last_clean":"2022-05-02T09:39:11.365430+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:11.365430+0000","last_undegraded":"2022-05-02T09:39:11.365430+0000","last_fullsized":"2022-05-02T09:39:11.365430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.356788+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:11.356788+0000","last_peered":"2022-05-02T09:39:11.356788+0000","last_clean":"2022-05-02T09:39:11.356788+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:11.356788+0000","last_undegraded":"2022-05-02T09:39:11.356788+0000","last_fullsized":"2022-05-02T09:39:11.356788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367056+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:11.367056+0000","last_peered":"2022-05-02T09:39:11.367056+0000","last_clean":"2022-05-02T09:39:11.367056+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:11.367056+0000","last_undegraded":"2022-05-02T09:39:11.367056+0000","last_fullsized":"2022-05-02T09:39:11.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366274+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:11.366274+0000","last_peered":"2022-05-02T09:39:11.366274+0000","last_clean":"2022-05-02T09:39:11.366274+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:11.366274+0000","last_undegraded":"2022-05-02T09:39:11.366274+0000","last_fullsized":"2022-05-02T09:39:11.366274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365262+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:11.365262+0000","last_peered":"2022-05-02T09:39:11.365262+0000","last_clean":"2022-05-02T09:39:11.365262+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:11.365262+0000","last_undegraded":"2022-05-02T09:39:11.365262+0000","last_fullsized":"2022-05-02T09:39:11.365262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360079+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:11.360079+0000","last_peered":"2022-05-02T09:39:11.360079+0000","last_clean":"2022-05-02T09:39:11.360079+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:11.360079+0000","last_undegraded":"2022-05-02T09:39:11.360079+0000","last_fullsized":"2022-05-02T09:39:11.360079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360396+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:11.360396+0000","last_peered":"2022-05-02T09:39:11.360396+0000","last_clean":"2022-05-02T09:39:11.360396+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:11.360396+0000","last_undegraded":"2022-05-02T09:39:11.360396+0000","last_fullsized":"2022-05-02T09:39:11.360396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361409+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:11.361409+0000","last_peered":"2022-05-02T09:39:11.361409+0000","last_clean":"2022-05-02T09:39:11.361409+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:11.361409+0000","last_undegraded":"2022-05-02T09:39:11.361409+0000","last_fullsized":"2022-05-02T09:39:11.361409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367015+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:11.367015+0000","last_peered":"2022-05-02T09:39:11.367015+0000","last_clean":"2022-05-02T09:39:11.367015+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:11.367015+0000","last_undegraded":"2022-05-02T09:39:11.367015+0000","last_fullsized":"2022-05-02T09:39:11.367015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360228+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:11.360228+0000","last_peered":"2022-05-02T09:39:11.360228+0000","last_clean":"2022-05-02T09:39:11.360228+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:11.360228+0000","last_undegraded":"2022-05-02T09:39:11.360228+0000","last_fullsized":"2022-05-02T09:39:11.360228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360570+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:11.360570+0000","last_peered":"2022-05-02T09:39:11.360570+0000","last_clean":"2022-05-02T09:39:11.360570+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:11.360570+0000","last_undegraded":"2022-05-02T09:39:11.360570+0000","last_fullsized":"2022-05-02T09:39:11.360570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374260+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:11.374260+0000","last_peered":"2022-05-02T09:39:11.374260+0000","last_clean":"2022-05-02T09:39:11.374260+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:11.374260+0000","last_undegraded":"2022-05-02T09:39:11.374260+0000","last_fullsized":"2022-05-02T09:39:11.374260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312943+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:11.312943+0000","last_peered":"2022-05-02T09:39:11.312943+0000","last_clean":"2022-05-02T09:39:11.312943+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:11.312943+0000","last_undegraded":"2022-05-02T09:39:11.312943+0000","last_fullsized":"2022-05-02T09:39:11.312943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369975+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:11.369975+0000","last_peered":"2022-05-02T09:39:11.369975+0000","last_clean":"2022-05-02T09:39:11.369975+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:11.369975+0000","last_undegraded":"2022-05-02T09:39:11.369975+0000","last_fullsized":"2022-05-02T09:39:11.369975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175205+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:13.175205+0000","last_peered":"2022-05-02T09:39:13.175205+0000","last_clean":"2022-05-02T09:39:13.175205+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:13.175205+0000","last_undegraded":"2022-05-02T09:39:13.175205+0000","last_fullsized":"2022-05-02T09:39:13.175205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374280+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:11.374280+0000","last_peered":"2022-05-02T09:39:11.374280+0000","last_clean":"2022-05-02T09:39:11.374280+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:11.374280+0000","last_undegraded":"2022-05-02T09:39:11.374280+0000","last_fullsized":"2022-05-02T09:39:11.374280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349121+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:39:14.349121+0000","last_peered":"2022-05-02T09:39:14.349121+0000","last_clean":"2022-05-02T09:39:14.349121+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:39:14.349121+0000","last_undegraded":"2022-05-02T09:39:14.349121+0000","last_fullsized":"2022-05-02T09:39:14.349121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.342612+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:11.342612+0000","last_peered":"2022-05-02T09:39:11.342612+0000","last_clean":"2022-05-02T09:39:11.342612+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:11.342612+0000","last_undegraded":"2022-05-02T09:39:11.342612+0000","last_fullsized":"2022-05-02T09:39:11.342612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:14.347064+0000","last_peered":"2022-05-02T09:39:14.347064+0000","last_clean":"2022-05-02T09:39:14.347064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:14.347064+0000","last_undegraded":"2022-05-02T09:39:14.347064+0000","last_fullsized":"2022-05-02T09:39:14.347064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360056+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:11.360056+0000","last_peered":"2022-05-02T09:39:11.360056+0000","last_clean":"2022-05-02T09:39:11.360056+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:11.360056+0000","last_undegraded":"2022-05-02T09:39:11.360056+0000","last_fullsized":"2022-05-02T09:39:11.360056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312107+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:12.312107+0000","last_peered":"2022-05-02T09:39:12.312107+0000","last_clean":"2022-05-02T09:39:12.312107+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:12.312107+0000","last_undegraded":"2022-05-02T09:39:12.312107+0000","last_fullsized":"2022-05-02T09:39:12.312107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366331+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:11.366331+0000","last_peered":"2022-05-02T09:39:11.366331+0000","last_clean":"2022-05-02T09:39:11.366331+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:11.366331+0000","last_undegraded":"2022-05-02T09:39:11.366331+0000","last_fullsized":"2022-05-02T09:39:11.366331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346844+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:39:14.346844+0000","last_peered":"2022-05-02T09:39:14.346844+0000","last_clean":"2022-05-02T09:39:14.346844+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:39:14.346844+0000","last_undegraded":"2022-05-02T09:39:14.346844+0000","last_fullsized":"2022-05-02T09:39:14.346844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355173+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:11.355173+0000","last_peered":"2022-05-02T09:39:11.355173+0000","last_clean":"2022-05-02T09:39:11.355173+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:11.355173+0000","last_undegraded":"2022-05-02T09:39:11.355173+0000","last_fullsized":"2022-05-02T09:39:11.355173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346940+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:14.346940+0000","last_peered":"2022-05-02T09:39:14.346940+0000","last_clean":"2022-05-02T09:39:14.346940+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:14.346940+0000","last_undegraded":"2022-05-02T09:39:14.346940+0000","last_fullsized":"2022-05-02T09:39:14.346940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374300+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:11.374300+0000","last_peered":"2022-05-02T09:39:11.374300+0000","last_clean":"2022-05-02T09:39:11.374300+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:11.374300+0000","last_undegraded":"2022-05-02T09:39:11.374300+0000","last_fullsized":"2022-05-02T09:39:11.374300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347966+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:14.347966+0000","last_peered":"2022-05-02T09:39:14.347966+0000","last_clean":"2022-05-02T09:39:14.347966+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:14.347966+0000","last_undegraded":"2022-05-02T09:39:14.347966+0000","last_fullsized":"2022-05-02T09:39:14.347966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360201+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:11.360201+0000","last_peered":"2022-05-02T09:39:11.360201+0000","last_clean":"2022-05-02T09:39:11.360201+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:11.360201+0000","last_undegraded":"2022-05-02T09:39:11.360201+0000","last_fullsized":"2022-05-02T09:39:11.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313705+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:11.313705+0000","last_peered":"2022-05-02T09:39:11.313705+0000","last_clean":"2022-05-02T09:39:11.313705+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:11.313705+0000","last_undegraded":"2022-05-02T09:39:11.313705+0000","last_fullsized":"2022-05-02T09:39:11.313705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357485+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:11.357485+0000","last_peered":"2022-05-02T09:39:11.357485+0000","last_clean":"2022-05-02T09:39:11.357485+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:11.357485+0000","last_undegraded":"2022-05-02T09:39:11.357485+0000","last_fullsized":"2022-05-02T09:39:11.357485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.344885+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:14.344885+0000","last_peered":"2022-05-02T09:39:14.344885+0000","last_clean":"2022-05-02T09:39:14.344885+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:14.344885+0000","last_undegraded":"2022-05-02T09:39:14.344885+0000","last_fullsized":"2022-05-02T09:39:14.344885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374217+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:11.374217+0000","last_peered":"2022-05-02T09:39:11.374217+0000","last_clean":"2022-05-02T09:39:11.374217+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:11.374217+0000","last_undegraded":"2022-05-02T09:39:11.374217+0000","last_fullsized":"2022-05-02T09:39:11.374217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368927+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:11.368927+0000","last_peered":"2022-05-02T09:39:11.368927+0000","last_clean":"2022-05-02T09:39:11.368927+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:11.368927+0000","last_undegraded":"2022-05-02T09:39:11.368927+0000","last_fullsized":"2022-05-02T09:39:11.368927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.373265+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:11.373265+0000","last_peered":"2022-05-02T09:39:11.373265+0000","last_clean":"2022-05-02T09:39:11.373265+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:11.373265+0000","last_undegraded":"2022-05-02T09:39:11.373265+0000","last_fullsized":"2022-05-02T09:39:11.373265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.348885+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:11.348885+0000","last_peered":"2022-05-02T09:39:11.348885+0000","last_clean":"2022-05-02T09:39:11.348885+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:11.348885+0000","last_undegraded":"2022-05-02T09:39:11.348885+0000","last_fullsized":"2022-05-02T09:39:11.348885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360401+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:11.360401+0000","last_peered":"2022-05-02T09:39:11.360401+0000","last_clean":"2022-05-02T09:39:11.360401+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:11.360401+0000","last_undegraded":"2022-05-02T09:39:11.360401+0000","last_fullsized":"2022-05-02T09:39:11.360401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.372713+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:11.372713+0000","last_peered":"2022-05-02T09:39:11.372713+0000","last_clean":"2022-05-02T09:39:11.372713+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:11.372713+0000","last_undegraded":"2022-05-02T09:39:11.372713+0000","last_fullsized":"2022-05-02T09:39:11.372713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357412+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:11.357412+0000","last_peered":"2022-05-02T09:39:11.357412+0000","last_clean":"2022-05-02T09:39:11.357412+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:11.357412+0000","last_undegraded":"2022-05-02T09:39:11.357412+0000","last_fullsized":"2022-05-02T09:39:11.357412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.325992+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:11.325992+0000","last_peered":"2022-05-02T09:39:11.325992+0000","last_clean":"2022-05-02T09:39:11.325992+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:11.325992+0000","last_undegraded":"2022-05-02T09:39:11.325992+0000","last_fullsized":"2022-05-02T09:39:11.325992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365391+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:11.365391+0000","last_peered":"2022-05-02T09:39:11.365391+0000","last_clean":"2022-05-02T09:39:11.365391+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:11.365391+0000","last_undegraded":"2022-05-02T09:39:11.365391+0000","last_fullsized":"2022-05-02T09:39:11.365391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346299+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:14.346299+0000","last_peered":"2022-05-02T09:39:14.346299+0000","last_clean":"2022-05-02T09:39:14.346299+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:14.346299+0000","last_undegraded":"2022-05-02T09:39:14.346299+0000","last_fullsized":"2022-05-02T09:39:14.346299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347440+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:11.347440+0000","last_peered":"2022-05-02T09:39:11.347440+0000","last_clean":"2022-05-02T09:39:11.347440+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:11.347440+0000","last_undegraded":"2022-05-02T09:39:11.347440+0000","last_fullsized":"2022-05-02T09:39:11.347440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313970+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:11.313970+0000","last_peered":"2022-05-02T09:39:11.313970+0000","last_clean":"2022-05-02T09:39:11.313970+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:11.313970+0000","last_undegraded":"2022-05-02T09:39:11.313970+0000","last_fullsized":"2022-05-02T09:39:11.313970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374357+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:11.374357+0000","last_peered":"2022-05-02T09:39:11.374357+0000","last_clean":"2022-05-02T09:39:11.374357+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:11.374357+0000","last_undegraded":"2022-05-02T09:39:11.374357+0000","last_fullsized":"2022-05-02T09:39:11.374357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347002+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:14.347002+0000","last_peered":"2022-05-02T09:39:14.347002+0000","last_clean":"2022-05-02T09:39:14.347002+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:14.347002+0000","last_undegraded":"2022-05-02T09:39:14.347002+0000","last_fullsized":"2022-05-02T09:39:14.347002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357166+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:11.357166+0000","last_peered":"2022-05-02T09:39:11.357166+0000","last_clean":"2022-05-02T09:39:11.357166+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:11.357166+0000","last_undegraded":"2022-05-02T09:39:11.357166+0000","last_fullsized":"2022-05-02T09:39:11.357166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346745+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:14.346745+0000","last_peered":"2022-05-02T09:39:14.346745+0000","last_clean":"2022-05-02T09:39:14.346745+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:14.346745+0000","last_undegraded":"2022-05-02T09:39:14.346745+0000","last_fullsized":"2022-05-02T09:39:14.346745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361382+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:11.361382+0000","last_peered":"2022-05-02T09:39:11.361382+0000","last_clean":"2022-05-02T09:39:11.361382+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:11.361382+0000","last_undegraded":"2022-05-02T09:39:11.361382+0000","last_fullsized":"2022-05-02T09:39:11.361382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.321742+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:11.321742+0000","last_peered":"2022-05-02T09:39:11.321742+0000","last_clean":"2022-05-02T09:39:11.321742+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:11.321742+0000","last_undegraded":"2022-05-02T09:39:11.321742+0000","last_fullsized":"2022-05-02T09:39:11.321742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.309990+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:12.309990+0000","last_peered":"2022-05-02T09:39:12.309990+0000","last_clean":"2022-05-02T09:39:12.309990+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:12.309990+0000","last_undegraded":"2022-05-02T09:39:12.309990+0000","last_fullsized":"2022-05-02T09:39:12.309990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366309+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:11.366309+0000","last_peered":"2022-05-02T09:39:11.366309+0000","last_clean":"2022-05-02T09:39:11.366309+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:11.366309+0000","last_undegraded":"2022-05-02T09:39:11.366309+0000","last_fullsized":"2022-05-02T09:39:11.366309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313812+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:11.313812+0000","last_peered":"2022-05-02T09:39:11.313812+0000","last_clean":"2022-05-02T09:39:11.313812+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:11.313812+0000","last_undegraded":"2022-05-02T09:39:11.313812+0000","last_fullsized":"2022-05-02T09:39:11.313812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346586+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:14.346586+0000","last_peered":"2022-05-02T09:39:14.346586+0000","last_clean":"2022-05-02T09:39:14.346586+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:14.346586+0000","last_undegraded":"2022-05-02T09:39:14.346586+0000","last_fullsized":"2022-05-02T09:39:14.346586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361284+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:11.361284+0000","last_peered":"2022-05-02T09:39:11.361284+0000","last_clean":"2022-05-02T09:39:11.361284+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:11.361284+0000","last_undegraded":"2022-05-02T09:39:11.361284+0000","last_fullsized":"2022-05-02T09:39:11.361284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.316222+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:11.316222+0000","last_peered":"2022-05-02T09:39:11.316222+0000","last_clean":"2022-05-02T09:39:11.316222+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:11.316222+0000","last_undegraded":"2022-05-02T09:39:11.316222+0000","last_fullsized":"2022-05-02T09:39:11.316222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.737867+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:12.737867+0000","last_peered":"2022-05-02T09:39:12.737867+0000","last_clean":"2022-05-02T09:39:12.737867+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:12.737867+0000","last_undegraded":"2022-05-02T09:39:12.737867+0000","last_fullsized":"2022-05-02T09:39:12.737867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367748+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:11.367748+0000","last_peered":"2022-05-02T09:39:11.367748+0000","last_clean":"2022-05-02T09:39:11.367748+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:11.367748+0000","last_undegraded":"2022-05-02T09:39:11.367748+0000","last_fullsized":"2022-05-02T09:39:11.367748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313763+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:11.313763+0000","last_peered":"2022-05-02T09:39:11.313763+0000","last_clean":"2022-05-02T09:39:11.313763+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:11.313763+0000","last_undegraded":"2022-05-02T09:39:11.313763+0000","last_fullsized":"2022-05-02T09:39:11.313763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312314+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:11.312314+0000","last_peered":"2022-05-02T09:39:11.312314+0000","last_clean":"2022-05-02T09:39:11.312314+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:11.312314+0000","last_undegraded":"2022-05-02T09:39:11.312314+0000","last_fullsized":"2022-05-02T09:39:11.312314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313542+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:11.313542+0000","last_peered":"2022-05-02T09:39:11.313542+0000","last_clean":"2022-05-02T09:39:11.313542+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:11.313542+0000","last_undegraded":"2022-05-02T09:39:11.313542+0000","last_fullsized":"2022-05-02T09:39:11.313542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374380+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:11.374380+0000","last_peered":"2022-05-02T09:39:11.374380+0000","last_clean":"2022-05-02T09:39:11.374380+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:11.374380+0000","last_undegraded":"2022-05-02T09:39:11.374380+0000","last_fullsized":"2022-05-02T09:39:11.374380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312941+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:11.312941+0000","last_peered":"2022-05-02T09:39:11.312941+0000","last_clean":"2022-05-02T09:39:11.312941+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:11.312941+0000","last_undegraded":"2022-05-02T09:39:11.312941+0000","last_fullsized":"2022-05-02T09:39:11.312941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.311122+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:12.311122+0000","last_peered":"2022-05-02T09:39:12.311122+0000","last_clean":"2022-05-02T09:39:12.311122+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:12.311122+0000","last_undegraded":"2022-05-02T09:39:12.311122+0000","last_fullsized":"2022-05-02T09:39:12.311122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365451+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:11.365451+0000","last_peered":"2022-05-02T09:39:11.365451+0000","last_clean":"2022-05-02T09:39:11.365451+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:11.365451+0000","last_undegraded":"2022-05-02T09:39:11.365451+0000","last_fullsized":"2022-05-02T09:39:11.365451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.319431+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:11.319431+0000","last_peered":"2022-05-02T09:39:11.319431+0000","last_clean":"2022-05-02T09:39:11.319431+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:11.319431+0000","last_undegraded":"2022-05-02T09:39:11.319431+0000","last_fullsized":"2022-05-02T09:39:11.319431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.317299+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:11.317299+0000","last_peered":"2022-05-02T09:39:11.317299+0000","last_clean":"2022-05-02T09:39:11.317299+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:11.317299+0000","last_undegraded":"2022-05-02T09:39:11.317299+0000","last_fullsized":"2022-05-02T09:39:11.317299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365371+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:11.365371+0000","last_peered":"2022-05-02T09:39:11.365371+0000","last_clean":"2022-05-02T09:39:11.365371+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:11.365371+0000","last_undegraded":"2022-05-02T09:39:11.365371+0000","last_fullsized":"2022-05-02T09:39:11.365371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346024+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:14.346024+0000","last_peered":"2022-05-02T09:39:14.346024+0000","last_clean":"2022-05-02T09:39:14.346024+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:14.346024+0000","last_undegraded":"2022-05-02T09:39:14.346024+0000","last_fullsized":"2022-05-02T09:39:14.346024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.320945+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:11.320945+0000","last_peered":"2022-05-02T09:39:11.320945+0000","last_clean":"2022-05-02T09:39:11.320945+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:11.320945+0000","last_undegraded":"2022-05-02T09:39:11.320945+0000","last_fullsized":"2022-05-02T09:39:11.320945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374239+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:11.374239+0000","last_peered":"2022-05-02T09:39:11.374239+0000","last_clean":"2022-05-02T09:39:11.374239+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:11.374239+0000","last_undegraded":"2022-05-02T09:39:11.374239+0000","last_fullsized":"2022-05-02T09:39:11.374239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.314878+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:11.314878+0000","last_peered":"2022-05-02T09:39:11.314878+0000","last_clean":"2022-05-02T09:39:11.314878+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:11.314878+0000","last_undegraded":"2022-05-02T09:39:11.314878+0000","last_fullsized":"2022-05-02T09:39:11.314878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.333311+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:11.333311+0000","last_peered":"2022-05-02T09:39:11.333311+0000","last_clean":"2022-05-02T09:39:11.333311+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:11.333311+0000","last_undegraded":"2022-05-02T09:39:11.333311+0000","last_fullsized":"2022-05-02T09:39:11.333311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.345426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:11.345426+0000","last_peered":"2022-05-02T09:39:11.345426+0000","last_clean":"2022-05-02T09:39:11.345426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:11.345426+0000","last_undegraded":"2022-05-02T09:39:11.345426+0000","last_fullsized":"2022-05-02T09:39:11.345426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349020+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:14.349020+0000","last_peered":"2022-05-02T09:39:14.349020+0000","last_clean":"2022-05-02T09:39:14.349020+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:14.349020+0000","last_undegraded":"2022-05-02T09:39:14.349020+0000","last_fullsized":"2022-05-02T09:39:14.349020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367944+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:11.367944+0000","last_peered":"2022-05-02T09:39:11.367944+0000","last_clean":"2022-05-02T09:39:11.367944+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:11.367944+0000","last_undegraded":"2022-05-02T09:39:11.367944+0000","last_fullsized":"2022-05-02T09:39:11.367944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361211+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:11.361211+0000","last_peered":"2022-05-02T09:39:11.361211+0000","last_clean":"2022-05-02T09:39:11.361211+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:11.361211+0000","last_undegraded":"2022-05-02T09:39:11.361211+0000","last_fullsized":"2022-05-02T09:39:11.361211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355195+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:11.355195+0000","last_peered":"2022-05-02T09:39:11.355195+0000","last_clean":"2022-05-02T09:39:11.355195+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:11.355195+0000","last_undegraded":"2022-05-02T09:39:11.355195+0000","last_fullsized":"2022-05-02T09:39:11.355195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354864+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:11.354864+0000","last_peered":"2022-05-02T09:39:11.354864+0000","last_clean":"2022-05-02T09:39:11.354864+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:11.354864+0000","last_undegraded":"2022-05-02T09:39:11.354864+0000","last_fullsized":"2022-05-02T09:39:11.354864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357437+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:11.357437+0000","last_peered":"2022-05-02T09:39:11.357437+0000","last_clean":"2022-05-02T09:39:11.357437+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:11.357437+0000","last_undegraded":"2022-05-02T09:39:11.357437+0000","last_fullsized":"2022-05-02T09:39:11.357437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347169+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:11.347169+0000","last_peered":"2022-05-02T09:39:11.347169+0000","last_clean":"2022-05-02T09:39:11.347169+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:11.347169+0000","last_undegraded":"2022-05-02T09:39:11.347169+0000","last_fullsized":"2022-05-02T09:39:11.347169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336363+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:11.336363+0000","last_peered":"2022-05-02T09:39:11.336363+0000","last_clean":"2022-05-02T09:39:11.336363+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:11.336363+0000","last_undegraded":"2022-05-02T09:39:11.336363+0000","last_fullsized":"2022-05-02T09:39:11.336363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369133+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:11.369133+0000","last_peered":"2022-05-02T09:39:11.369133+0000","last_clean":"2022-05-02T09:39:11.369133+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:11.369133+0000","last_undegraded":"2022-05-02T09:39:11.369133+0000","last_fullsized":"2022-05-02T09:39:11.369133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367896+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:11.367896+0000","last_peered":"2022-05-02T09:39:11.367896+0000","last_clean":"2022-05-02T09:39:11.367896+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:11.367896+0000","last_undegraded":"2022-05-02T09:39:11.367896+0000","last_fullsized":"2022-05-02T09:39:11.367896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360368+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:11.360368+0000","last_peered":"2022-05-02T09:39:11.360368+0000","last_clean":"2022-05-02T09:39:11.360368+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:11.360368+0000","last_undegraded":"2022-05-02T09:39:11.360368+0000","last_fullsized":"2022-05-02T09:39:11.360368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.346985+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:11.346985+0000","last_peered":"2022-05-02T09:39:11.346985+0000","last_clean":"2022-05-02T09:39:11.346985+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:11.346985+0000","last_undegraded":"2022-05-02T09:39:11.346985+0000","last_fullsized":"2022-05-02T09:39:11.346985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347483+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:11.347483+0000","last_peered":"2022-05-02T09:39:11.347483+0000","last_clean":"2022-05-02T09:39:11.347483+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:11.347483+0000","last_undegraded":"2022-05-02T09:39:11.347483+0000","last_fullsized":"2022-05-02T09:39:11.347483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374132+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:11.374132+0000","last_peered":"2022-05-02T09:39:11.374132+0000","last_clean":"2022-05-02T09:39:11.374132+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:11.374132+0000","last_undegraded":"2022-05-02T09:39:11.374132+0000","last_fullsized":"2022-05-02T09:39:11.374132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368847+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:11.368847+0000","last_peered":"2022-05-02T09:39:11.368847+0000","last_clean":"2022-05-02T09:39:11.368847+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:11.368847+0000","last_undegraded":"2022-05-02T09:39:11.368847+0000","last_fullsized":"2022-05-02T09:39:11.368847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":56079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}]}} 2022-05-02T09:39:17.021 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-05-02T09:39:17.021 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-05-02T09:39:17.021 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-05-02T09:39:17.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-05-02T09:39:17.022 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-05-02T09:39:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.225+0000 7fd791b9d700 1 Processor -- start 2022-05-02T09:39:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.225+0000 7fd791b9d700 1 -- start start 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 0x7fd78c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c139010 con 0x7fd78c139b00 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1392d0 con 0x7fd78c05cc50 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.226+0000 7fd791b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0a7c50 con 0x7fd78c139720 2022-05-02T09:39:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd790b9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 0x7fd78c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd78bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50226/0 (socket says 172.21.15.50:50226) 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 -- 172.21.15.50:0/3640011858 learned_addr learned my addr 172.21.15.50:0/3640011858 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd78bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35646/0 (socket says 172.21.15.50:35646) 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd790b9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 0x7fd78c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49542/0 (socket says 172.21.15.50:49542) 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 -- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 msgr2=0x7fd78c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 --2- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 0x7fd78c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 -- 172.21.15.50:0/3640011858 >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 msgr2=0x7fd78c05d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 --2- 172.21.15.50:0/3640011858 >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd79139c700 1 -- 172.21.15.50:0/3640011858 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0a95d0 con 0x7fd78c05cc50 2022-05-02T09:39:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.227+0000 7fd78bfff700 1 --2- 172.21.15.50:0/3640011858 >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd79139c700 1 --2- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd7840032f0 tx=0x7fd784009290).ready entity=mon.1 client_cookie=8667e5d304a5bd67 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd78b7fe700 1 -- 172.21.15.50:0/3640011858 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78400b6c0 con 0x7fd78c05cc50 2022-05-02T09:39:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd78b7fe700 1 -- 172.21.15.50:0/3640011858 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78400b820 con 0x7fd78c05cc50 2022-05-02T09:39:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd78b7fe700 1 -- 172.21.15.50:0/3640011858 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78400b990 con 0x7fd78c05cc50 2022-05-02T09:39:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd791b9d700 1 -- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 msgr2=0x7fd78c05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.228+0000 7fd791b9d700 1 --2- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd7840032f0 tx=0x7fd784009290).stop 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 -- 172.21.15.50:0/3640011858 shutdown_connections 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 --2- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c05cc50 0x7fd78c05fca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 --2- 172.21.15.50:0/3640011858 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c139720 0x7fd78c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 --2- 172.21.15.50:0/3640011858 >> v2:172.21.15.50:3300/0 conn(0x7fd78c139b00 0x7fd78c05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 -- 172.21.15.50:0/3640011858 >> 172.21.15.50:0/3640011858 conn(0x7fd78c0669d0 msgr2=0x7fd78c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 -- 172.21.15.50:0/3640011858 shutdown_connections 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.229+0000 7fd791b9d700 1 -- 172.21.15.50:0/3640011858 wait complete. 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.230+0000 7fd791b9d700 1 Processor -- start 2022-05-02T09:39:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.230+0000 7fd791b9d700 1 -- start start 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 0x7fd78c0a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c139b00 0x7fd78c148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c132910 con 0x7fd78c139720 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0a14a0 con 0x7fd78c139b00 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd791b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c148a50 con 0x7fd78c05cc50 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd790b9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd78bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 0x7fd78c0a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd790b9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49544/0 (socket says 172.21.15.50:49544) 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.231+0000 7fd790b9b700 1 -- 172.21.15.50:0/958149205 learned_addr learned my addr 172.21.15.50:0/958149205 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd79139c700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c139b00 0x7fd78c148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 -- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c139b00 msgr2=0x7fd78c148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c139b00 0x7fd78c148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 -- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 msgr2=0x7fd78c0a2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 0x7fd78c0a2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 -- 172.21.15.50:0/958149205 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77800b180 con 0x7fd78c05cc50 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd78bfff700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 0x7fd78c0a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:17.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.232+0000 7fd790b9b700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd78000c000 tx=0x7fd780006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.233+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd780010780 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.233+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7800108e0 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.233+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd784009530 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.233+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd780010c40 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.233+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0a0630 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.234+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fd78001c460 con 0x7fd78c05cc50 2022-05-02T09:39:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.234+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c05d100 con 0x7fd78c05cc50 2022-05-02T09:39:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.235+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd78004a770 con 0x7fd78c05cc50 2022-05-02T09:39:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.238+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd7800331d0 con 0x7fd78c05cc50 2022-05-02T09:39:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.386+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd78c0a27d0 con 0x7fd78c05cc50 2022-05-02T09:39:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.388+0000 7fd789ffb700 1 -- 172.21.15.50:0/958149205 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+84355 (secure 0 0 0) 0x7fd780032dc0 con 0x7fd78c05cc50 2022-05-02T09:39:17.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.390+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 >> v1:172.21.15.50:6800/30011 conn(0x7fd76c038940 legacy=0x7fd76c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.390+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 msgr2=0x7fd78c0a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.390+0000 7fd791b9d700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd78000c000 tx=0x7fd780006df0).stop 2022-05-02T09:39:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 shutdown_connections 2022-05-02T09:39:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd78c05cc50 0x7fd78c0a0fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd78c139b00 0x7fd78c148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 --2- 172.21.15.50:0/958149205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c139720 0x7fd78c0a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 >> 172.21.15.50:0/958149205 conn(0x7fd78c0669d0 msgr2=0x7fd78c0aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 shutdown_connections 2022-05-02T09:39:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.391+0000 7fd791b9d700 1 -- 172.21.15.50:0/958149205 wait complete. 2022-05-02T09:39:17.416 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6800","nonce":30011}]},"active_addr":"172.21.15.50:6800/30011","active_change":"2022-05-02T09:38:50.316449+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1390228452}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":59626694}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4112136070}]}]}} 2022-05-02T09:39:17.428 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-05-02T09:39:17.428 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-05-02T09:39:17.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.633+0000 7f627899d700 1 Processor -- start 2022-05-02T09:39:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.633+0000 7f627899d700 1 -- start start 2022-05-02T09:39:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.634+0000 7f627899d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139b00 0x7f627405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.634+0000 7f627899d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 0x7f62741402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.634+0000 7f627899d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627405d360 con 0x7f6274139720 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.634+0000 7f627899d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6274139010 con 0x7f627405d7d0 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.634+0000 7f627899d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62741392d0 con 0x7f6274139b00 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139b00 0x7f627405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f62737fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6274139720 0x7f627405cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52164/0 (socket says 172.21.15.50:52164) 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f62737fe700 1 -- 172.21.15.50:0/1917358782 learned_addr learned my addr 172.21.15.50:0/1917358782 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6273fff700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 0x7f62741402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6273fff700 1 -- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139b00 msgr2=0x7f627405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6273fff700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139b00 0x7f627405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6273fff700 1 -- 172.21.15.50:0/1917358782 >> v1:172.21.15.50:6789/0 conn(0x7f6274139720 legacy=0x7f627405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.635+0000 7f6273fff700 1 -- 172.21.15.50:0/1917358782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740a7c50 con 0x7f627405d7d0 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f6273fff700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 0x7f62741402a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f626c0032f0 tx=0x7f626c0091d0).ready entity=mon.1 client_cookie=869c8138ff61a6b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f62727fc700 1 -- 172.21.15.50:0/1917358782 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626c00b6c0 con 0x7f627405d7d0 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f62727fc700 1 -- 172.21.15.50:0/1917358782 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00b820 con 0x7f627405d7d0 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f62727fc700 1 -- 172.21.15.50:0/1917358782 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626c00b990 con 0x7f627405d7d0 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 -- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 msgr2=0x7f62741402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 0x7f62741402a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f626c0032f0 tx=0x7f626c0091d0).stop 2022-05-02T09:39:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 -- 172.21.15.50:0/1917358782 shutdown_connections 2022-05-02T09:39:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f627405d7d0 0x7f62741402a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 --2- 172.21.15.50:0/1917358782 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139b00 0x7f627405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.636+0000 7f627899d700 1 -- 172.21.15.50:0/1917358782 >> 172.21.15.50:0/1917358782 conn(0x7f62740669d0 msgr2=0x7f62740a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.637+0000 7f627899d700 1 -- 172.21.15.50:0/1917358782 shutdown_connections 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.637+0000 7f627899d700 1 -- 172.21.15.50:0/1917358782 wait complete. 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.638+0000 7f627899d700 1 Processor -- start 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.638+0000 7f627899d700 1 -- start start 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 0x7f62740a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6274139b00 0x7f6274145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274136880 con 0x7f627405d7d0 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62741453f0 con 0x7f6274139b00 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f627899d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6274136230 con 0x7f6274139720 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f62737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 0x7f62740a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49550/0 (socket says 172.21.15.50:49550) 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f6272ffd700 1 -- 172.21.15.50:0/4181900607 learned_addr learned my addr 172.21.15.50:0/4181900607 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.640+0000 7f6273fff700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6274139b00 0x7f6274145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 -- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 msgr2=0x7f6274145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 -- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6274139b00 msgr2=0x7f6274145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6274139b00 0x7f6274145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 -- 172.21.15.50:0/4181900607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009470 con 0x7f627405d7d0 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f6272ffd700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f62737fe700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 0x7f62740a0840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f62740a9b00 tx=0x7f6264007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626400ce80 con 0x7f627405d7d0 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640070d0 con 0x7f627405d7d0 2022-05-02T09:39:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62741363f0 con 0x7f627405d7d0 2022-05-02T09:39:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6264007430 con 0x7f627405d7d0 2022-05-02T09:39:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.641+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62741350e0 con 0x7f627405d7d0 2022-05-02T09:39:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.642+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62741366d0 con 0x7f627405d7d0 2022-05-02T09:39:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.642+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f6264010070 con 0x7f627405d7d0 2022-05-02T09:39:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.643+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6264049690 con 0x7f627405d7d0 2022-05-02T09:39:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.646+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f626402e750 con 0x7f627405d7d0 2022-05-02T09:39:17.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.770+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6274146310 con 0x7f627405d7d0 2022-05-02T09:39:17.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.771+0000 7f6270ff9700 1 -- 172.21.15.50:0/4181900607 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f6264018030 con 0x7f627405d7d0 2022-05-02T09:39:17.773 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:17.773 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:12.304403+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.772+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 >> v1:172.21.15.50:6800/30011 conn(0x7f6254038970 legacy=0x7f625403ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.772+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 msgr2=0x7f62740a0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.772+0000 7f627899d700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 0x7f62740a0840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f62740a9b00 tx=0x7f6264007b80).stop 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 shutdown_connections 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6274139b00 0x7f6274145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627405d7d0 0x7f62740a0840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 --2- 172.21.15.50:0/4181900607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6274139720 0x7f6274145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 >> 172.21.15.50:0/4181900607 conn(0x7f62740669d0 msgr2=0x7f627405fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 shutdown_connections 2022-05-02T09:39:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:17.773+0000 7f627899d700 1 -- 172.21.15.50:0/4181900607 wait complete. 2022-05-02T09:39:17.799 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-05-02T09:39:17.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:18.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.001+0000 7f7f551ff700 1 Processor -- start 2022-05-02T09:39:18.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.001+0000 7f7f551ff700 1 -- start start 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 0x7f7f501372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f500a4810 con 0x7f7f50136bc0 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500671b0 con 0x7f7f50066a80 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f551ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500a4570 con 0x7f7f501367e0 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.002+0000 7f7f4f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 0x7f7f501372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50234/0 (socket says 172.21.15.50:50234) 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 -- 172.21.15.50:0/2021780446 learned_addr learned my addr 172.21.15.50:0/2021780446 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49554/0 (socket says 172.21.15.50:49554) 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 -- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 msgr2=0x7f7f500a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 -- 172.21.15.50:0/2021780446 >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 msgr2=0x7f7f501372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 --2- 172.21.15.50:0/2021780446 >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 0x7f7f501372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 -- 172.21.15.50:0/2021780446 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500a42c0 con 0x7f7f50066a80 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4e59c700 1 --2- 172.21.15.50:0/2021780446 >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 0x7f7f501372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4ed9d700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.003+0000 7f7f4f59e700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f500a4950 tx=0x7f7f48009290).ready entity=mon.1 client_cookie=70b5e71ca9da1f98 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f4dd9b700 1 -- 172.21.15.50:0/2021780446 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4800b6b0 con 0x7f7f50066a80 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f4dd9b700 1 -- 172.21.15.50:0/2021780446 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800b810 con 0x7f7f50066a80 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f4dd9b700 1 -- 172.21.15.50:0/2021780446 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4800b980 con 0x7f7f50066a80 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 -- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 msgr2=0x7f7f501377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f500a4950 tx=0x7f7f48009290).stop 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 -- 172.21.15.50:0/2021780446 shutdown_connections 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f50066a80 0x7f7f501377b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 --2- 172.21.15.50:0/2021780446 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f501367e0 0x7f7f500a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 --2- 172.21.15.50:0/2021780446 >> v2:172.21.15.50:3300/0 conn(0x7f7f50136bc0 0x7f7f501372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 -- 172.21.15.50:0/2021780446 >> 172.21.15.50:0/2021780446 conn(0x7f7f500a8690 msgr2=0x7f7f500a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.004+0000 7f7f551ff700 1 -- 172.21.15.50:0/2021780446 shutdown_connections 2022-05-02T09:39:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.005+0000 7f7f551ff700 1 -- 172.21.15.50:0/2021780446 wait complete. 2022-05-02T09:39:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.006+0000 7f7f551ff700 1 Processor -- start 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.006+0000 7f7f551ff700 1 -- start start 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 0x7f7f5009e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 0x7f7f50132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5009eb30 con 0x7f7f50066a80 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5009edf0 con 0x7f7f501367e0 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f551ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5013a110 con 0x7f7f50136bc0 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 0x7f7f5009e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50236/0 (socket says 172.21.15.50:50236) 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 -- 172.21.15.50:0/3761091607 learned_addr learned my addr 172.21.15.50:0/3761091607 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 0x7f7f5009e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35654/0 (socket says 172.21.15.50:35654) 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4f59e700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 0x7f7f50132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 -- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 msgr2=0x7f7f50132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 0x7f7f50132a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 -- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 msgr2=0x7f7f5009e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 0x7f7f5009e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4e59c700 1 -- 172.21.15.50:0/3761091607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4000b180 con 0x7f7f501367e0 2022-05-02T09:39:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.007+0000 7f7f4f59e700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 0x7f7f50132a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f4e59c700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7f4400c000 tx=0x7f7f44006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f44010780 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f440108e0 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f44010c40 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4400b180 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.008+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48009530 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.009+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f7f4401c460 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.009+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5009f4f0 con 0x7f7f501367e0 2022-05-02T09:39:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.010+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7f4404a930 con 0x7f7f501367e0 2022-05-02T09:39:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.013+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7f44033390 con 0x7f7f501367e0 2022-05-02T09:39:18.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.136+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f50067c40 con 0x7f7f501367e0 2022-05-02T09:39:18.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.137+0000 7f7f3ffff700 1 -- 172.21.15.50:0/3761091607 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f7f44032f80 con 0x7f7f501367e0 2022-05-02T09:39:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:18.140 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:12.304403+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:18.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 >> v1:172.21.15.50:6800/30011 conn(0x7f7f2c0389d0 legacy=0x7f7f2c03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 msgr2=0x7f7f50132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7f4400c000 tx=0x7f7f44006df0).stop 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 shutdown_connections 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7f50136bc0 0x7f7f50132a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f50066a80 0x7f7f5009e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 --2- 172.21.15.50:0/3761091607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f501367e0 0x7f7f50132510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 >> 172.21.15.50:0/3761091607 conn(0x7f7f500a8690 msgr2=0x7f7f500a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 shutdown_connections 2022-05-02T09:39:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.139+0000 7f7f551ff700 1 -- 172.21.15.50:0/3761091607 wait complete. 2022-05-02T09:39:18.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-05-02T09:39:18.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-05-02T09:39:18.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-05-02T09:39:18.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-05-02T09:39:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.397+0000 7fdcdd59d700 1 Processor -- start 2022-05-02T09:39:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.397+0000 7fdcdd59d700 1 -- start start 2022-05-02T09:39:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.398+0000 7fdcdd59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 0x7fdcd805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.398+0000 7fdcdd59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd81402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.398+0000 7fdcdd59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd805d360 con 0x7fdcd8139720 2022-05-02T09:39:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.398+0000 7fdcdd59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8139010 con 0x7fdcd8139b00 2022-05-02T09:39:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.398+0000 7fdcdd59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81392d0 con 0x7fdcd805d7d0 2022-05-02T09:39:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.399+0000 7fdcd7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdcd8139720 0x7fdcd805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52166/0 (socket says 172.21.15.50:52166) 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.399+0000 7fdcd7fff700 1 -- 172.21.15.50:0/1784085988 learned_addr learned my addr 172.21.15.50:0/1784085988 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.399+0000 7fdcdcd9c700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd81402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.399+0000 7fdcd77fe700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 0x7fdcd805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd77fe700 1 -- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 msgr2=0x7fdcd81402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd77fe700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd81402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd77fe700 1 -- 172.21.15.50:0/1784085988 >> v1:172.21.15.50:6789/0 conn(0x7fdcd8139720 legacy=0x7fdcd805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd77fe700 1 -- 172.21.15.50:0/1784085988 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80a7c50 con 0x7fdcd8139b00 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd6ffd700 1 -- 172.21.15.50:0/1784085988 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222363374 0 0) 0x7fdcd805d360 con 0x7fdcd8139720 2022-05-02T09:39:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.400+0000 7fdcd77fe700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 0x7fdcd805b8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc006df0).ready entity=mon.1 client_cookie=b16a3e19267f8166 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.401+0000 7fdcd6ffd700 1 -- 172.21.15.50:0/1784085988 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdccc00d570 con 0x7fdcd8139b00 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.401+0000 7fdcd6ffd700 1 -- 172.21.15.50:0/1784085988 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc000e90 con 0x7fdcd8139b00 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.401+0000 7fdcd6ffd700 1 -- 172.21.15.50:0/1784085988 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdccc00d8c0 con 0x7fdcd8139b00 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 -- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 msgr2=0x7fdcd805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 0x7fdcd805b8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc006df0).stop 2022-05-02T09:39:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7f48b51ff700 1 Processor -- start 2022-05-02T09:39:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 -- 172.21.15.50:0/1784085988 shutdown_connections 2022-05-02T09:39:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd81402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 --2- 172.21.15.50:0/1784085988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139b00 0x7fdcd805b8a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 -- 172.21.15.50:0/1784085988 >> 172.21.15.50:0/1784085988 conn(0x7fdcd80669d0 msgr2=0x7fdcd80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 -- 172.21.15.50:0/1784085988 shutdown_connections 2022-05-02T09:39:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.402+0000 7fdcdd59d700 1 -- 172.21.15.50:0/1784085988 wait complete. 2022-05-02T09:39:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.403+0000 7f48b51ff700 1 -- start start 2022-05-02T09:39:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7fdcdd59d700 1 Processor -- start 2022-05-02T09:39:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f0c85d9d700 1 Processor -- start 2022-05-02T09:39:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7fdcdd59d700 1 -- start start 2022-05-02T09:39:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f0c85d9d700 1 -- start start 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 0x7f48b0092980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48b00994c0 0x7f48b00998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b01393c0 0x7f48b0135de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b0093950 con 0x7f48b00994c0 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0139d50 con 0x7f48b01393c0 2022-05-02T09:39:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.404+0000 7f48b51ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48b013a010 con 0x7f48b0060fd0 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.405+0000 7f48aed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 0x7f48b0092980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.405+0000 7f48aed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 0x7f48b0092980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49560/0 (socket says 172.21.15.50:49560) 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.405+0000 7f48aed9d700 1 -- 172.21.15.50:0/155040257 learned_addr learned my addr 172.21.15.50:0/155040257 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.405+0000 7f48ae59c700 1 --2- 172.21.15.50:0/155040257 >> v2:172.21.15.50:3300/0 conn(0x7f48b00994c0 0x7f48b00998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.405+0000 7f48af59e700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b01393c0 0x7f48b0135de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 -- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 msgr2=0x7f48b0092980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 0x7f48b0092980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 -- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b01393c0 msgr2=0x7f48b0135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b01393c0 0x7f48b0135de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 -- 172.21.15.50:0/155040257 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0092e70 con 0x7f48b00994c0 2022-05-02T09:39:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd8064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139720 0x7fdcd812e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd8139b00 0x7fdcd812ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8065910 con 0x7fdcd8139b00 2022-05-02T09:39:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8064460 con 0x7fdcd8139720 2022-05-02T09:39:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcdd59d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8064700 con 0x7fdcd805d7d0 2022-05-02T09:39:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f48ae59c700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00998a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f48a4002f70 tx=0x7f48a4006df0).ready entity=mon.0 client_cookie=7357b797ba4f987f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcd77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139720 0x7fdcd812e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcd77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139720 0x7fdcd812e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50242/0 (socket says 172.21.15.50:50242) 2022-05-02T09:39:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7fdcd77fe700 1 -- 172.21.15.50:0/2593966277 learned_addr learned my addr 172.21.15.50:0/2593966277 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd8139b00 0x7fdcd812ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcd7fff700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd8064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f0c85d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c801327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f0c85d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c80136140 0x7f0c801365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f0c85d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800a7270 con 0x7f0c800a6e90 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f0c85d9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c80094760 con 0x7f0c80136140 2022-05-02T09:39:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.406+0000 7f0c85d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80135ea0 con 0x7f0c80095430 2022-05-02T09:39:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f0c84d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c800a6e90 0x7f0c801330b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52168/0 (socket says 172.21.15.50:52168) 2022-05-02T09:39:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f0c84d9b700 1 -- 172.21.15.50:0/318316977 learned_addr learned my addr 172.21.15.50:0/318316977 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f0c8559c700 1 --2- 172.21.15.50:0/318316977 >> v2:172.21.15.50:3300/0 conn(0x7f0c80136140 0x7f0c801365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f48add9b700 1 -- 172.21.15.50:0/155040257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a400d570 con 0x7f48b00994c0 2022-05-02T09:39:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f48add9b700 1 -- 172.21.15.50:0/155040257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4000e90 con 0x7f48b00994c0 2022-05-02T09:39:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7f48add9b700 1 -- 172.21.15.50:0/155040257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a400d8c0 con 0x7f48b00994c0 2022-05-02T09:39:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 -- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 msgr2=0x7fdcd8064d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdcd805d7d0 0x7fdcd8064d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 -- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139720 msgr2=0x7fdcd812e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdcd8139720 0x7fdcd812e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.407+0000 7fdcdcd9c700 1 -- 172.21.15.50:0/2593966277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc00b180 con 0x7fdcd8139b00 2022-05-02T09:39:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7f0c8559c700 1 -- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 msgr2=0x7f0c801327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7f0c8559c700 1 --2- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c801327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7fdcdcd9c700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd8139b00 0x7fdcd812ea90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdcd000c000 tx=0x7fdcd00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd000c610 con 0x7fdcd8139b00 2022-05-02T09:39:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000c770 con 0x7fdcd8139b00 2022-05-02T09:39:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd000cad0 con 0x7fdcd8139b00 2022-05-02T09:39:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd8132e10 con 0x7fdcd8139b00 2022-05-02T09:39:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7f0c8559c700 1 -- 172.21.15.50:0/318316977 >> v1:172.21.15.50:6789/0 conn(0x7f0c800a6e90 legacy=0x7f0c801330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7f0c8559c700 1 -- 172.21.15.50:0/318316977 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80136ac0 con 0x7f0c80136140 2022-05-02T09:39:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.408+0000 7f0c7f7fe700 1 -- 172.21.15.50:0/318316977 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327398322 0 0) 0x7f0c800a7270 con 0x7f0c800a6e90 2022-05-02T09:39:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 -- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 msgr2=0x7f48b00998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00998a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f48a4002f70 tx=0x7f48a4006df0).stop 2022-05-02T09:39:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd81327a0 con 0x7fdcd8139b00 2022-05-02T09:39:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f0c8559c700 1 --2- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c801365d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0c780032f0 tx=0x7f0c780091d0).ready entity=mon.0 client_cookie=611292161021282d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 -- 172.21.15.50:0/155040257 shutdown_connections 2022-05-02T09:39:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b01393c0 0x7f48b0135de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b0060fd0 0x7f48b0092980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 --2- 172.21.15.50:0/155040257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00998a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.409+0000 7f48b51ff700 1 -- 172.21.15.50:0/155040257 >> 172.21.15.50:0/155040257 conn(0x7f48b00a7e80 msgr2=0x7f48b00a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7f48b51ff700 1 -- 172.21.15.50:0/155040257 shutdown_connections 2022-05-02T09:39:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7f0c7f7fe700 1 -- 172.21.15.50:0/318316977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c78009ea0 con 0x7f0c80136140 2022-05-02T09:39:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7f0c7f7fe700 1 -- 172.21.15.50:0/318316977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800b8a0 con 0x7f0c80136140 2022-05-02T09:39:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7f0c7f7fe700 1 -- 172.21.15.50:0/318316977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c7800ba10 con 0x7f0c80136140 2022-05-02T09:39:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7f48b51ff700 1 -- 172.21.15.50:0/155040257 wait complete. 2022-05-02T09:39:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.410+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcb0003660 con 0x7fdcd8139b00 2022-05-02T09:39:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 -- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 msgr2=0x7f0c801365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 --2- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c801365d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0c780032f0 tx=0x7f0c780091d0).stop 2022-05-02T09:39:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 -- 172.21.15.50:0/318316977 shutdown_connections 2022-05-02T09:39:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 --2- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c801365d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 --2- 172.21.15.50:0/318316977 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c801327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 -- 172.21.15.50:0/318316977 >> 172.21.15.50:0/318316977 conn(0x7f0c8005b8a0 msgr2=0x7f0c8005bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fdcd0022070 con 0x7fdcd8139b00 2022-05-02T09:39:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 -- 172.21.15.50:0/318316977 shutdown_connections 2022-05-02T09:39:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.411+0000 7f0c85d9d700 1 -- 172.21.15.50:0/318316977 wait complete. 2022-05-02T09:39:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.412+0000 7f48b51ff700 1 Processor -- start 2022-05-02T09:39:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.412+0000 7f48b51ff700 1 -- start start 2022-05-02T09:39:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.412+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdcd004a990 con 0x7fdcd8139b00 2022-05-02T09:39:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.412+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 --> v1:172.21.15.50:6809/30638 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcb8045220 con 0x7fdcb8041610 2022-05-02T09:39:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.412+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd004f170 con 0x7fdcd8139b00 2022-05-02T09:39:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b0060fd0 0x7f48b0095f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b01393c0 0x7f48b0141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0094a20 con 0x7f48b00994c0 2022-05-02T09:39:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0094b90 con 0x7f48b0060fd0 2022-05-02T09:39:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48b51ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48b01413a0 con 0x7f48b01393c0 2022-05-02T09:39:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f0c85d9d700 1 Processor -- start 2022-05-02T09:39:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48ae59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48ae59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35662/0 (socket says 172.21.15.50:35662) 2022-05-02T09:39:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f48ae59c700 1 -- 172.21.15.50:0/1118445072 learned_addr learned my addr 172.21.15.50:0/1118445072 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.413+0000 7f0c85d9d700 1 -- start start 2022-05-02T09:39:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48aed9d700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b0060fd0 0x7f48b0095f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48af59e700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b01393c0 0x7f48b0141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48ae59c700 1 -- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b01393c0 msgr2=0x7f48b0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48ae59c700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b01393c0 0x7f48b0141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48ae59c700 1 -- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b0060fd0 msgr2=0x7f48b0095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48ae59c700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48b0060fd0 0x7f48b0095f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48ae59c700 1 -- 172.21.15.50:0/1118445072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a400b180 con 0x7f48b00994c0 2022-05-02T09:39:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.414+0000 7f48af59e700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f48b01393c0 0x7f48b0141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:39:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f48ae59c700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00970f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f48a4002f70 tx=0x7f48a4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c80061b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0c800a6e90 0x7f0c801351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c80067610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80062ff0 con 0x7f0c80136140 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800632b0 con 0x7f0c800a6e90 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c85d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80099500 con 0x7f0c80095430 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c84d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c80061b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c8559c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c80067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c8559c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c80067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35664/0 (socket says 172.21.15.50:35664) 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c8559c700 1 -- 172.21.15.50:0/356022908 learned_addr learned my addr 172.21.15.50:0/356022908 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.415+0000 7f0c7ffff700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0c800a6e90 0x7f0c801351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== osd.1 v1:172.21.15.50:6809/30638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fdcb8045220 con 0x7fdcb8041610 2022-05-02T09:39:18.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 -- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 msgr2=0x7f0c80061b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0c80095430 0x7f0c80061b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 -- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0c800a6e90 msgr2=0x7f0c801351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0c800a6e90 0x7f0c801351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 -- 172.21.15.50:0/356022908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009470 con 0x7f0c80136140 2022-05-02T09:39:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a4016070 con 0x7f48b00994c0 2022-05-02T09:39:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f0c8559c700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c80067610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0c780032f0 tx=0x7f0c78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400de60 con 0x7f48b00994c0 2022-05-02T09:39:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a401e450 con 0x7f48b00994c0 2022-05-02T09:39:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.416+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00975e0 con 0x7f48b00994c0 2022-05-02T09:39:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b0093de0 con 0x7f48b00994c0 2022-05-02T09:39:18.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c78021630 con 0x7f0c80136140 2022-05-02T09:39:18.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c78021790 con 0x7f0c80136140 2022-05-02T09:39:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c801356d0 con 0x7f0c80136140 2022-05-02T09:39:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c80067b00 con 0x7f0c80136140 2022-05-02T09:39:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.417+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c78021af0 con 0x7f0c80136140 2022-05-02T09:39:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.418+0000 7f0c7ffff700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0c800a6e90 0x7f0c801351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.419+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48b0091bc0 con 0x7f48b00994c0 2022-05-02T09:39:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.419+0000 7efed159d700 1 Processor -- start 2022-05-02T09:39:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.419+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f48a400f030 con 0x7f48b00994c0 2022-05-02T09:39:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.420+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f48a404b050 con 0x7f48b00994c0 2022-05-02T09:39:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.419+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c80061900 con 0x7f0c80136140 2022-05-02T09:39:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.420+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0c78027020 con 0x7f0c80136140 2022-05-02T09:39:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.419+0000 7efed159d700 1 -- start start 2022-05-02T09:39:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.420+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 --> v1:172.21.15.50:6801/30634 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f488c0451c0 con 0x7f488c041510 2022-05-02T09:39:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.420+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48a404d5c0 con 0x7f48b00994c0 2022-05-02T09:39:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.420+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0c7804f170 con 0x7f0c80136140 2022-05-02T09:39:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 --> v1:172.21.15.50:6805/30635 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c60045230 con 0x7f0c60041580 2022-05-02T09:39:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c7804f3b0 con 0x7f0c80136140 2022-05-02T09:39:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7efed159d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 0x7efecc139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7efed159d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efecc13a340 0x7efecc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7efed159d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc091d60 con 0x7efecc092280 2022-05-02T09:39:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7efed159d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc13a890 con 0x7efecc13a340 2022-05-02T09:39:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.421+0000 7efed159d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efecc13ab30 con 0x7efecc0a81b0 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.422+0000 7efec3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 0x7efecc139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.422+0000 7efed0d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efecc13a340 0x7efecc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.422+0000 7efec3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 0x7efecc139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49572/0 (socket says 172.21.15.50:49572) 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.422+0000 7efec3fff700 1 -- 172.21.15.50:0/3997257638 learned_addr learned my addr 172.21.15.50:0/3997257638 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efed0d9c700 1 -- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 msgr2=0x7efecc139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efed0d9c700 1 --2- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 0x7efecc139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efed0d9c700 1 -- 172.21.15.50:0/3997257638 >> v1:172.21.15.50:6789/0 conn(0x7efecc092280 legacy=0x7efecc0a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efed0d9c700 1 -- 172.21.15.50:0/3997257638 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc05c470 con 0x7efecc13a340 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efed0d9c700 1 --2- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc13a340 0x7efecc1447a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efec40032f0 tx=0x7efec40091d0).ready entity=mon.0 client_cookie=5dc5599d17e8e6d0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efecb7fe700 1 -- 172.21.15.50:0/3997257638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec400b6c0 con 0x7efecc13a340 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efecb7fe700 1 -- 172.21.15.50:0/3997257638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400b820 con 0x7efecc13a340 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7efecb7fe700 1 -- 172.21.15.50:0/3997257638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec400b990 con 0x7efecc13a340 2022-05-02T09:39:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.423+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== osd.0 v1:172.21.15.50:6801/30634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f488c0451c0 con 0x7f488c041510 2022-05-02T09:39:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== osd.2 v1:172.21.15.50:6805/30635 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f0c60045230 con 0x7f0c60041580 2022-05-02T09:39:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7efed159d700 1 -- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc13a340 msgr2=0x7efecc1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7efed159d700 1 --2- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc13a340 0x7efecc1447a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efec40032f0 tx=0x7efec40091d0).stop 2022-05-02T09:39:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7efed159d700 1 -- 172.21.15.50:0/3997257638 shutdown_connections 2022-05-02T09:39:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7efed159d700 1 --2- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc13a340 0x7efecc1447a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.424+0000 7efed159d700 1 --2- 172.21.15.50:0/3997257638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc0a81b0 0x7efecc139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.425+0000 7efed159d700 1 -- 172.21.15.50:0/3997257638 >> 172.21.15.50:0/3997257638 conn(0x7efecc05b8a0 msgr2=0x7efecc05bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.425+0000 7efed159d700 1 -- 172.21.15.50:0/3997257638 shutdown_connections 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.425+0000 7efed159d700 1 -- 172.21.15.50:0/3997257638 wait complete. 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.426+0000 7efed159d700 1 Processor -- start 2022-05-02T09:39:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.426+0000 7efed159d700 1 -- start start 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 0x7efecc065b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efecc0a81b0 0x7efecc14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc13a340 0x7efecc14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc147330 con 0x7efecc092280 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0679d0 con 0x7efecc0a81b0 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed159d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efecc066950 con 0x7efecc13a340 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efecbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 0x7efecc065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed0d9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc13a340 0x7efecc14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efecbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 0x7efecc065b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35668/0 (socket says 172.21.15.50:35668) 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efecbfff700 1 -- 172.21.15.50:0/2557076491 learned_addr learned my addr 172.21.15.50:0/2557076491 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.428+0000 7efed0d9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc13a340 0x7efecc14d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49574/0 (socket says 172.21.15.50:49574) 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efec3fff700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efecc0a81b0 0x7efecc14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 -- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc13a340 msgr2=0x7efecc14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efecc13a340 0x7efecc14d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 -- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efecc0a81b0 msgr2=0x7efecc14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efecc0a81b0 0x7efecc14cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 -- 172.21.15.50:0/2557076491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009470 con 0x7efecc092280 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efec3fff700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efecc0a81b0 0x7efecc14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.429+0000 7efecbfff700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 0x7efecc065b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7efecc093090 tx=0x7efebc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.430+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc012400 con 0x7efecc092280 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.430+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc012560 con 0x7efecc092280 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.430+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc14cb50 con 0x7efecc092280 2022-05-02T09:39:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.430+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc0128c0 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.430+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc066ba0 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.431+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7efebc019030 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.431+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efecc064e70 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.432+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efebc0497e0 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.433+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 --> v1:172.21.15.50:6813/30665 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efeb0045250 con 0x7efeb00415a0 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.433+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7efebc04bca0 con 0x7efecc092280 2022-05-02T09:39:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.435+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== osd.3 v1:172.21.15.50:6813/30665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7efeb0045250 con 0x7efeb00415a0 2022-05-02T09:39:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.443+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 --> v1:172.21.15.50:6809/30638 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdcb0002810 con 0x7fdcb8041610 2022-05-02T09:39:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7fdcd57fa700 1 -- 172.21.15.50:0/2593966277 <== osd.1 v1:172.21.15.50:6809/30638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7fdcb0002810 con 0x7fdcb8041610 2022-05-02T09:39:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 --> v1:172.21.15.50:6801/30634 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48b0057990 con 0x7f488c041510 2022-05-02T09:39:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 >> v1:172.21.15.50:6809/30638 conn(0x7fdcb8041610 legacy=0x7fdcb8043a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 >> v1:172.21.15.50:6800/30011 conn(0x7fdcb8038a60 legacy=0x7fdcb803af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd8139b00 msgr2=0x7fdcd812ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.444+0000 7fdcdd59d700 1 --2- 172.21.15.50:0/2593966277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd8139b00 0x7fdcd812ea90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdcd000c000 tx=0x7fdcd00091d0).stop 2022-05-02T09:39:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7fdcdcd9c700 1 -- 172.21.15.50:0/2593966277 reap_dead start 2022-05-02T09:39:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7f489ffff700 1 -- 172.21.15.50:0/1118445072 <== osd.0 v1:172.21.15.50:6801/30634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7f48b0057990 con 0x7f488c041510 2022-05-02T09:39:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 shutdown_connections 2022-05-02T09:39:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 >> 172.21.15.50:0/2593966277 conn(0x7fdcd80669d0 msgr2=0x7fdcd805cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 shutdown_connections 2022-05-02T09:39:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.445+0000 7fdcdd59d700 1 -- 172.21.15.50:0/2593966277 wait complete. 2022-05-02T09:39:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 >> v1:172.21.15.50:6801/30634 conn(0x7f488c041510 legacy=0x7f488c043950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 >> v1:172.21.15.50:6800/30011 conn(0x7f488c038940 legacy=0x7f488c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 msgr2=0x7f48b00970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 --2- 172.21.15.50:0/1118445072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48b00994c0 0x7f48b00970f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f48a4002f70 tx=0x7f48a4014000).stop 2022-05-02T09:39:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48af59e700 1 -- 172.21.15.50:0/1118445072 reap_dead start 2022-05-02T09:39:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 --> v1:172.21.15.50:6805/30635 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c80129ce0 con 0x7f0c60041580 2022-05-02T09:39:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 shutdown_connections 2022-05-02T09:39:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.446+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 >> 172.21.15.50:0/1118445072 conn(0x7f48b00a7e80 msgr2=0x7f48b00a6060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.447+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 shutdown_connections 2022-05-02T09:39:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.447+0000 7f0c7dffb700 1 -- 172.21.15.50:0/356022908 <== osd.2 v1:172.21.15.50:6805/30635 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7f0c80129ce0 con 0x7f0c60041580 2022-05-02T09:39:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.447+0000 7f48b51ff700 1 -- 172.21.15.50:0/1118445072 wait complete. 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.447+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 >> v1:172.21.15.50:6805/30635 conn(0x7f0c60041580 legacy=0x7f0c600439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.447+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 >> v1:172.21.15.50:6800/30011 conn(0x7f0c600389d0 legacy=0x7f0c6003ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 msgr2=0x7f0c80067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 --2- 172.21.15.50:0/356022908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c80136140 0x7f0c80067610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0c780032f0 tx=0x7f0c78016000).stop 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c8559c700 1 -- 172.21.15.50:0/356022908 reap_dead start 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 shutdown_connections 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 >> 172.21.15.50:0/356022908 conn(0x7f0c8005b8a0 msgr2=0x7f0c80096170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 shutdown_connections 2022-05-02T09:39:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.448+0000 7f0c85d9d700 1 -- 172.21.15.50:0/356022908 wait complete. 2022-05-02T09:39:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.458+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 --> v1:172.21.15.50:6813/30665 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efecc06c070 con 0x7efeb00415a0 2022-05-02T09:39:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.459+0000 7efec9ffb700 1 -- 172.21.15.50:0/2557076491 <== osd.3 v1:172.21.15.50:6813/30665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7efecc06c070 con 0x7efeb00415a0 2022-05-02T09:39:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 >> v1:172.21.15.50:6813/30665 conn(0x7efeb00415a0 legacy=0x7efeb00439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 >> v1:172.21.15.50:6800/30011 conn(0x7efeb0038970 legacy=0x7efeb003ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 msgr2=0x7efecc065b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 --2- 172.21.15.50:0/2557076491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efecc092280 0x7efecc065b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7efecc093090 tx=0x7efebc007c50).stop 2022-05-02T09:39:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed0d9c700 1 -- 172.21.15.50:0/2557076491 reap_dead start 2022-05-02T09:39:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 shutdown_connections 2022-05-02T09:39:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.460+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 >> 172.21.15.50:0/2557076491 conn(0x7efecc05b8a0 msgr2=0x7efecc0a3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.461+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 shutdown_connections 2022-05-02T09:39:18.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.461+0000 7efed159d700 1 -- 172.21.15.50:0/2557076491 wait complete. 2022-05-02T09:39:18.476 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:18.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:39:18.484 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:18.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:39:18.486 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:18.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:39:18.490 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:18.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:39:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.719+0000 7f9b8c9fe700 1 Processor -- start 2022-05-02T09:39:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.719+0000 7f9b8c9fe700 1 -- start start 2022-05-02T09:39:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.719+0000 7f847d99d700 1 Processor -- start 2022-05-02T09:39:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f847d99d700 1 -- start start 2022-05-02T09:39:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f9b8c9fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b880a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f9b8c9fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 0x7f9b881367a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f9b8c9fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880abd00 con 0x7f9b8805fca0 2022-05-02T09:39:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f9b8c9fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880aa750 con 0x7f9b880ab920 2022-05-02T09:39:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.720+0000 7f9b8c9fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880a7bc0 con 0x7f9b881363c0 2022-05-02T09:39:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f9b8659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 0x7f9b881367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f9b8659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 0x7f9b881367a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35670/0 (socket says 172.21.15.50:35670) 2022-05-02T09:39:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f9b8659c700 1 -- 172.21.15.50:0/836449528 learned_addr learned my addr 172.21.15.50:0/836449528 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f9b86d9d700 1 --2- 172.21.15.50:0/836449528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b880a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f9b86d9d700 1 -- 172.21.15.50:0/836449528 >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 msgr2=0x7f9b881367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f9b86d9d700 1 --2- 172.21.15.50:0/836449528 >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 0x7f9b881367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f9b86d9d700 1 -- 172.21.15.50:0/836449528 >> v1:172.21.15.50:6789/0 conn(0x7f9b8805fca0 legacy=0x7f9b88060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f9b86d9d700 1 -- 172.21.15.50:0/836449528 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880a7e60 con 0x7f9b881363c0 2022-05-02T09:39:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f847d99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8478139b00 0x7f847805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f847d99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f847805d7d0 0x7f84781402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.721+0000 7f847d99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847805d360 con 0x7f8478139720 2022-05-02T09:39:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f847d99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8478139010 con 0x7f8478139b00 2022-05-02T09:39:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f847d99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84781392d0 con 0x7f847805d7d0 2022-05-02T09:39:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f8477fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8478139b00 0x7f847805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f9b86d9d700 1 --2- 172.21.15.50:0/836449528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b880a8370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9b880abe90 tx=0x7f9b78006df0).ready entity=mon.1 client_cookie=a2783a5c7ca0e815 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f8477fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8478139b00 0x7f847805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35672/0 (socket says 172.21.15.50:35672) 2022-05-02T09:39:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f8477fff700 1 -- 172.21.15.50:0/3778132440 learned_addr learned my addr 172.21.15.50:0/3778132440 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.722+0000 7f847d19c700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f847805d7d0 0x7f84781402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f9b85d9b700 1 -- 172.21.15.50:0/836449528 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800d570 con 0x7f9b881363c0 2022-05-02T09:39:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f8477fff700 1 -- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f847805d7d0 msgr2=0x7f84781402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f8477fff700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f847805d7d0 0x7f84781402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f9b85d9b700 1 -- 172.21.15.50:0/836449528 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78000e90 con 0x7f9b881363c0 2022-05-02T09:39:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f9b85d9b700 1 -- 172.21.15.50:0/836449528 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800d900 con 0x7f9b881363c0 2022-05-02T09:39:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f8477fff700 1 -- 172.21.15.50:0/3778132440 >> v1:172.21.15.50:6789/0 conn(0x7f8478139720 legacy=0x7f847805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7f8477fff700 1 -- 172.21.15.50:0/3778132440 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780a7c50 con 0x7f8478139b00 2022-05-02T09:39:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.723+0000 7fa88979d700 1 Processor -- start 2022-05-02T09:39:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f8477fff700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8478139b00 0x7f847805b8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8464002f70 tx=0x7f8464006eb0).ready entity=mon.0 client_cookie=df8228a636706962 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/836449528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 msgr2=0x7f9b880a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/836449528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b880a8370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9b880abe90 tx=0x7f9b78006df0).stop 2022-05-02T09:39:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7fa88979d700 1 -- start start 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/836449528 shutdown_connections 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/836449528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b880a8370 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/836449528 >> v2:172.21.15.50:3300/0 conn(0x7f9b880ab920 0x7f9b881367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/836449528 >> 172.21.15.50:0/836449528 conn(0x7f9b880614f0 msgr2=0x7f9b88066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/836449528 shutdown_connections 2022-05-02T09:39:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f84777fe700 1 -- 172.21.15.50:0/3778132440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f846400d570 con 0x7f8478139b00 2022-05-02T09:39:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f84777fe700 1 -- 172.21.15.50:0/3778132440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464000e90 con 0x7f8478139b00 2022-05-02T09:39:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f84777fe700 1 -- 172.21.15.50:0/3778132440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f846400d900 con 0x7f8478139b00 2022-05-02T09:39:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.724+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/836449528 wait complete. 2022-05-02T09:39:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7f847d99d700 1 -- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8478139b00 msgr2=0x7f847805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7f847d99d700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8478139b00 0x7f847805b8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8464002f70 tx=0x7f8464006eb0).stop 2022-05-02T09:39:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7fa88979d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 0x7fa88405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7fa88979d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa8841402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7fa88979d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88405d360 con 0x7fa884139720 2022-05-02T09:39:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7fa88979d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa884139010 con 0x7fa884139b00 2022-05-02T09:39:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.725+0000 7fa88979d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841392d0 con 0x7fa88405d7d0 2022-05-02T09:39:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7ff723fff700 1 Processor -- start 2022-05-02T09:39:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f847d99d700 1 -- 172.21.15.50:0/3778132440 shutdown_connections 2022-05-02T09:39:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f847d99d700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f847805d7d0 0x7f84781402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f847d99d700 1 --2- 172.21.15.50:0/3778132440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8478139b00 0x7f847805b8a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f9b8c9fe700 1 Processor -- start 2022-05-02T09:39:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f847d99d700 1 -- 172.21.15.50:0/3778132440 >> 172.21.15.50:0/3778132440 conn(0x7f84780669d0 msgr2=0x7f84780a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7fa8837fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 0x7fa88405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7fa888f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa8841402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7fa8837fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 0x7fa88405b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35674/0 (socket says 172.21.15.50:35674) 2022-05-02T09:39:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7fa8837fe700 1 -- 172.21.15.50:0/4230202911 learned_addr learned my addr 172.21.15.50:0/4230202911 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7f9b8c9fe700 1 -- start start 2022-05-02T09:39:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7fa888f9c700 1 -- 172.21.15.50:0/4230202911 >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 msgr2=0x7fa88405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7fa888f9c700 1 --2- 172.21.15.50:0/4230202911 >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 0x7fa88405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7fa888f9c700 1 -- 172.21.15.50:0/4230202911 >> v1:172.21.15.50:6789/0 conn(0x7fa884139720 legacy=0x7fa88405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7fa888f9c700 1 -- 172.21.15.50:0/4230202911 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840a7c50 con 0x7fa88405d7d0 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7fa888f9c700 1 --2- 172.21.15.50:0/4230202911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa8841402a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa87c0032f0 tx=0x7fa87c0091d0).ready entity=mon.1 client_cookie=afc5c42d02907d7f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8805fca0 0x7f9b88113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 0x7f9b88148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b88148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880a2110 con 0x7f9b8805fca0 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880a44f0 con 0x7f9b881363c0 2022-05-02T09:39:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8c9fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880a2340 con 0x7f9b880ab920 2022-05-02T09:39:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7fa882ffd700 1 -- 172.21.15.50:0/4230202911 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c00b6c0 con 0x7fa88405d7d0 2022-05-02T09:39:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7fa882ffd700 1 -- 172.21.15.50:0/4230202911 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00b820 con 0x7fa88405d7d0 2022-05-02T09:39:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7fa882ffd700 1 -- 172.21.15.50:0/4230202911 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c00b990 con 0x7fa88405d7d0 2022-05-02T09:39:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b88148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b86d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8805fca0 0x7f9b88113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b88148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50256/0 (socket says 172.21.15.50:50256) 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7f9b8759e700 1 -- 172.21.15.50:0/3373034398 learned_addr learned my addr 172.21.15.50:0/3373034398 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7f9b8659c700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 0x7f9b88148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 -- 172.21.15.50:0/4230202911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 msgr2=0x7fa8841402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 --2- 172.21.15.50:0/4230202911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa8841402a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa87c0032f0 tx=0x7fa87c0091d0).stop 2022-05-02T09:39:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.726+0000 7ff723fff700 1 -- start start 2022-05-02T09:39:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7240ab920 0x7ff7241367a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff72405fca0 0x7ff724060120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240aa750 con 0x7ff72405fca0 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240abd00 con 0x7ff7241363c0 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.728+0000 7ff723fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240a7bc0 con 0x7ff7240ab920 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7ff722ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7ff722ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50258/0 (socket says 172.21.15.50:50258) 2022-05-02T09:39:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7ff722ffd700 1 -- 172.21.15.50:0/3398463405 learned_addr learned my addr 172.21.15.50:0/3398463405 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7f847d99d700 1 -- 172.21.15.50:0/3778132440 shutdown_connections 2022-05-02T09:39:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.727+0000 7f847d99d700 1 -- 172.21.15.50:0/3778132440 wait complete. 2022-05-02T09:39:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7f847d99d700 1 Processor -- start 2022-05-02T09:39:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7f847d99d700 1 -- start start 2022-05-02T09:39:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 -- 172.21.15.50:0/4230202911 shutdown_connections 2022-05-02T09:39:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 --2- 172.21.15.50:0/4230202911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa8841402a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 --2- 172.21.15.50:0/4230202911 >> v2:172.21.15.50:3300/0 conn(0x7fa884139b00 0x7fa88405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7fa88979d700 1 -- 172.21.15.50:0/4230202911 >> 172.21.15.50:0/4230202911 conn(0x7fa8840669d0 msgr2=0x7fa8840a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.729+0000 7ff7237fe700 1 --2- 172.21.15.50:0/3398463405 >> v2:172.21.15.50:3300/0 conn(0x7ff72405fca0 0x7ff724060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 -- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 msgr2=0x7f9b88148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b88148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 -- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8805fca0 msgr2=0x7f9b88113e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8805fca0 0x7f9b88113e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 -- 172.21.15.50:0/3373034398 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7800b180 con 0x7f9b880ab920 2022-05-02T09:39:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7fa88979d700 1 -- 172.21.15.50:0/4230202911 shutdown_connections 2022-05-02T09:39:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b8659c700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 0x7f9b88148830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9b7c00c000 tx=0x7f9b7c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7ff722ffd700 1 -- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7240ab920 msgr2=0x7ff7241367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7ff722ffd700 1 --2- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7240ab920 0x7ff7241367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7ff722ffd700 1 -- 172.21.15.50:0/3398463405 >> v2:172.21.15.50:3300/0 conn(0x7ff72405fca0 msgr2=0x7ff724060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7ff722ffd700 1 --2- 172.21.15.50:0/3398463405 >> v2:172.21.15.50:3300/0 conn(0x7ff72405fca0 0x7ff724060120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7ff722ffd700 1 -- 172.21.15.50:0/3398463405 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240a7e60 con 0x7ff7241363c0 2022-05-02T09:39:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7c013400 con 0x7f9b880ab920 2022-05-02T09:39:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c013560 con 0x7f9b880ab920 2022-05-02T09:39:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7c0138c0 con 0x7f9b880ab920 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847805d7d0 0x7f84781312c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8478139720 0x7f8478132270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84780a1770 con 0x7f847805d7d0 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84780a3110 con 0x7f8478139b00 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7f847d99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84780a1170 con 0x7f8478139720 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f847d19c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f8477fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8478139720 0x7f8478132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f847d19c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50260/0 (socket says 172.21.15.50:50260) 2022-05-02T09:39:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f847d19c700 1 -- 172.21.15.50:0/665824082 learned_addr learned my addr 172.21.15.50:0/665824082 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f847c99b700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847805d7d0 0x7f84781312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7ff722ffd700 1 --2- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff714002f70 tx=0x7ff714006eb0).ready entity=mon.1 client_cookie=345bd2fa1f8433d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.730+0000 7fa88979d700 1 -- 172.21.15.50:0/4230202911 wait complete. 2022-05-02T09:39:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7fa88979d700 1 Processor -- start 2022-05-02T09:39:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 -- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8478139720 msgr2=0x7f8478132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8478139720 0x7f8478132270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 -- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847805d7d0 msgr2=0x7f84781312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847805d7d0 0x7f84781312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 -- 172.21.15.50:0/665824082 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846400b1e0 con 0x7f8478139b00 2022-05-02T09:39:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7fa88979d700 1 -- start start 2022-05-02T09:39:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f847d19c700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8470006e00 tx=0x7f84700091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880a25e0 con 0x7f9b880ab920 2022-05-02T09:39:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.731+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88114300 con 0x7f9b880ab920 2022-05-02T09:39:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.732+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88136c90 con 0x7f9b880ab920 2022-05-02T09:39:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f847000c7f0 con 0x7f8478139b00 2022-05-02T09:39:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7ff721ffb700 1 -- 172.21.15.50:0/3398463405 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71400d570 con 0x7ff7241363c0 2022-05-02T09:39:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7ff721ffb700 1 -- 172.21.15.50:0/3398463405 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714000e90 con 0x7ff7241363c0 2022-05-02T09:39:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7ff721ffb700 1 -- 172.21.15.50:0/3398463405 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71400d900 con 0x7ff7241363c0 2022-05-02T09:39:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847000c950 con 0x7f8478139b00 2022-05-02T09:39:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f847000ccb0 con 0x7f8478139b00 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa884061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa884139b00 0x7fa884064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063100 con 0x7fa884139b00 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840642c0 con 0x7fa88405d7d0 2022-05-02T09:39:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7fa88979d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841323d0 con 0x7fa884139720 2022-05-02T09:39:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7ff723fff700 1 -- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 msgr2=0x7ff7240a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7ff723fff700 1 --2- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff714002f70 tx=0x7ff714006eb0).stop 2022-05-02T09:39:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7fa8837fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7fa8837fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49584/0 (socket says 172.21.15.50:49584) 2022-05-02T09:39:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7fa8837fe700 1 -- 172.21.15.50:0/536240633 learned_addr learned my addr 172.21.15.50:0/536240633 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7fa888f9c700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa884139b00 0x7fa884064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.733+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84780a37b0 con 0x7f8478139b00 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84780a2e30 con 0x7f8478139b00 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.734+0000 7fa883fff700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa884061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 -- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 msgr2=0x7fa884061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa884061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 -- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa884139b00 msgr2=0x7fa884064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa884139b00 0x7fa884064c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 -- 172.21.15.50:0/536240633 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009470 con 0x7fa884139720 2022-05-02T09:39:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f9b7c013a20 con 0x7f9b880ab920 2022-05-02T09:39:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7fa8837fe700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa87400c000 tx=0x7fa874008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7ff723fff700 1 -- 172.21.15.50:0/3398463405 shutdown_connections 2022-05-02T09:39:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7ff723fff700 1 --2- 172.21.15.50:0/3398463405 >> v2:172.21.15.50:3300/0 conn(0x7ff72405fca0 0x7ff724060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7ff723fff700 1 --2- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7241363c0 0x7ff7240a8370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7ff723fff700 1 --2- 172.21.15.50:0/3398463405 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7240ab920 0x7ff7241367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.735+0000 7ff723fff700 1 -- 172.21.15.50:0/3398463405 >> 172.21.15.50:0/3398463405 conn(0x7ff7240614f0 msgr2=0x7ff724066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.736+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9b7c04aaa0 con 0x7f9b880ab920 2022-05-02T09:39:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.736+0000 7ff723fff700 1 -- 172.21.15.50:0/3398463405 shutdown_connections 2022-05-02T09:39:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.736+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84780a2870 con 0x7f8478139b00 2022-05-02T09:39:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.736+0000 7ff723fff700 1 -- 172.21.15.50:0/3398463405 wait complete. 2022-05-02T09:39:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.737+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f84700123f0 con 0x7f8478139b00 2022-05-02T09:39:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.738+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f847004a620 con 0x7f8478139b00 2022-05-02T09:39:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.738+0000 7ff723fff700 1 Processor -- start 2022-05-02T09:39:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.738+0000 7ff723fff700 1 -- start start 2022-05-02T09:39:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8740136e0 con 0x7fa884139720 2022-05-02T09:39:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874013840 con 0x7fa884139720 2022-05-02T09:39:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa884132b60 con 0x7fa884139720 2022-05-02T09:39:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa874013ba0 con 0x7fa884139720 2022-05-02T09:39:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8840633b0 con 0x7fa884139720 2022-05-02T09:39:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.739+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9b7c033500 con 0x7f9b880ab920 2022-05-02T09:39:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff72405fca0 0x7ff7240a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7241363c0 0x7ff7240a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240a3a50 con 0x7ff7240ab920 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240a3bc0 con 0x7ff72405fca0 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff723fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240a5630 con 0x7ff7241363c0 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff7227fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff7227fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35686/0 (socket says 172.21.15.50:35686) 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.740+0000 7ff7227fc700 1 -- 172.21.15.50:0/1699510296 learned_addr learned my addr 172.21.15.50:0/1699510296 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:18.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fa874023070 con 0x7fa884139720 2022-05-02T09:39:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 -- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7241363c0 msgr2=0x7ff7240a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7241363c0 0x7ff7240a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 -- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff72405fca0 msgr2=0x7ff7240a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff72405fca0 0x7ff7240a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 -- 172.21.15.50:0/1699510296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71400b1e0 con 0x7ff7240ab920 2022-05-02T09:39:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.741+0000 7ff7227fc700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff7240a2ef0 tx=0x7ff718006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa87404a4a0 con 0x7fa884139720 2022-05-02T09:39:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884057990 con 0x7fa884139720 2022-05-02T09:39:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff718013460 con 0x7ff7240ab920 2022-05-02T09:39:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180135c0 con 0x7ff7240ab920 2022-05-02T09:39:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff718013920 con 0x7ff7240ab920 2022-05-02T09:39:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7240a5160 con 0x7ff7240ab920 2022-05-02T09:39:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.742+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f847002f4a0 con 0x7f8478139b00 2022-05-02T09:39:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.743+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7240a2a90 con 0x7ff7240ab920 2022-05-02T09:39:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.744+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7ff71801a060 con 0x7ff7240ab920 2022-05-02T09:39:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.744+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7240a3890 con 0x7ff7240ab920 2022-05-02T09:39:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.745+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff718049c10 con 0x7ff7240ab920 2022-05-02T09:39:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.747+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa874033010 con 0x7fa884139720 2022-05-02T09:39:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.751+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff7240a3890 con 0x7ff7240ab920 2022-05-02T09:39:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.872+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8478057990 con 0x7f8478139b00 2022-05-02T09:39:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.873+0000 7f8475ffb700 1 -- 172.21.15.50:0/665824082 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8470032c70 con 0x7f8478139b00 2022-05-02T09:39:18.875 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.875+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 >> v1:172.21.15.50:6800/30011 conn(0x7f8458038970 legacy=0x7f845803ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.875+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 msgr2=0x7f8478132760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.875+0000 7f847d99d700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8470006e00 tx=0x7f84700091d0).stop 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 shutdown_connections 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8478139b00 0x7f8478132760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847805d7d0 0x7f84781312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 --2- 172.21.15.50:0/665824082 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8478139720 0x7f8478132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 >> 172.21.15.50:0/665824082 conn(0x7f84780669d0 msgr2=0x7f847806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 shutdown_connections 2022-05-02T09:39:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7f847d99d700 1 -- 172.21.15.50:0/665824082 wait complete. 2022-05-02T09:39:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.876+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa884061b40 con 0x7fa884139720 2022-05-02T09:39:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.877+0000 7fa8817fa700 1 -- 172.21.15.50:0/536240633 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa874032c00 con 0x7fa884139720 2022-05-02T09:39:18.881 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 >> v1:172.21.15.50:6800/30011 conn(0x7fa8640389d0 legacy=0x7fa86403ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 msgr2=0x7fa884064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa87400c000 tx=0x7fa874008040).stop 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 shutdown_connections 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa884139b00 0x7fa884064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa88405d7d0 0x7fa884061eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 --2- 172.21.15.50:0/536240633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa884139720 0x7fa884064720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 >> 172.21.15.50:0/536240633 conn(0x7fa8840669d0 msgr2=0x7fa884137450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.879+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 shutdown_connections 2022-05-02T09:39:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.880+0000 7fa88979d700 1 -- 172.21.15.50:0/536240633 wait complete. 2022-05-02T09:39:18.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2022-05-02T09:39:18.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2022-05-02T09:39:18.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.914+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b88115660 con 0x7f9b880ab920 2022-05-02T09:39:18.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.914+0000 7f9b77fff700 1 -- 172.21.15.50:0/3373034398 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b7c029030 con 0x7f9b880ab920 2022-05-02T09:39:18.918 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 >> v1:172.21.15.50:6800/30011 conn(0x7f9b64038940 legacy=0x7f9b6403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 msgr2=0x7f9b88148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 0x7f9b88148830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9b7c00c000 tx=0x7f9b7c008040).stop 2022-05-02T09:39:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 shutdown_connections 2022-05-02T09:39:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b881363c0 0x7f9b88148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8805fca0 0x7f9b88113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 --2- 172.21.15.50:0/3373034398 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9b880ab920 0x7f9b88148830 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.916+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 >> 172.21.15.50:0/3373034398 conn(0x7f9b880614f0 msgr2=0x7f9b88133730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.917+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 shutdown_connections 2022-05-02T09:39:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.917+0000 7f9b8c9fe700 1 -- 172.21.15.50:0/3373034398 wait complete. 2022-05-02T09:39:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.931+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7240a3890 con 0x7ff7240ab920 2022-05-02T09:39:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.932+0000 7ff713fff700 1 -- 172.21.15.50:0/1699510296 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7240a3890 con 0x7ff7240ab920 2022-05-02T09:39:18.934 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.933+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 >> v1:172.21.15.50:6800/30011 conn(0x7ff7000389c0 legacy=0x7ff70003ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.933+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 msgr2=0x7ff7240a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff7240a2ef0 tx=0x7ff718006e90).stop 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 shutdown_connections 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff7241363c0 0x7ff7240a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff72405fca0 0x7ff7240a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-05-02T09:39:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 --2- 172.21.15.50:0/1699510296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240ab920 0x7ff7240a15c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 >> 172.21.15.50:0/1699510296 conn(0x7ff7240614f0 msgr2=0x7ff724132740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 shutdown_connections 2022-05-02T09:39:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:18.934+0000 7ff723fff700 1 -- 172.21.15.50:0/1699510296 wait complete. 2022-05-02T09:39:18.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.0 2022-05-02T09:39:18.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2022-05-02T09:39:19.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:39:19.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:39:19.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:39:19.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:39:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.148+0000 7fec8a79d700 1 Processor -- start 2022-05-02T09:39:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.148+0000 7fec8a79d700 1 -- start start 2022-05-02T09:39:20.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.149+0000 7fec8a79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec84139b00 0x7fec8405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec8a79d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec8a79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8405d360 con 0x7fec84139720 2022-05-02T09:39:20.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec8a79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84139010 con 0x7fec84139b00 2022-05-02T09:39:20.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec8a79d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec841392d0 con 0x7fec8405d7d0 2022-05-02T09:39:20.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec89f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.154 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec89f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50268/0 (socket says 172.21.15.50:50268) 2022-05-02T09:39:20.154 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec89f9c700 1 -- 172.21.15.50:0/3700129177 learned_addr learned my addr 172.21.15.50:0/3700129177 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:20.154 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec88f9a700 1 --2- 172.21.15.50:0/3700129177 >> v2:172.21.15.50:3300/0 conn(0x7fec84139b00 0x7fec8405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.154 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.150+0000 7fec8979b700 1 --1- 172.21.15.50:0/3700129177 >> v1:172.21.15.50:6789/0 conn(0x7fec84139720 0x7fec8405cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52178/0 (socket says 172.21.15.50:52178) 2022-05-02T09:39:20.154 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec88f9a700 1 -- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 msgr2=0x7fec841402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec88f9a700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec88f9a700 1 -- 172.21.15.50:0/3700129177 >> v1:172.21.15.50:6789/0 conn(0x7fec84139720 legacy=0x7fec8405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec88f9a700 1 -- 172.21.15.50:0/3700129177 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840a7c50 con 0x7fec84139b00 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec89f9c700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec88f9a700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec84139b00 0x7fec8405b8a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fec74002f70 tx=0x7fec74006df0).ready entity=mon.0 client_cookie=574f7f7d6b3972ef server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.151+0000 7fec73fff700 1 -- 172.21.15.50:0/3700129177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400d570 con 0x7fec84139b00 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec73fff700 1 -- 172.21.15.50:0/3700129177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74000e90 con 0x7fec84139b00 2022-05-02T09:39:20.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec73fff700 1 -- 172.21.15.50:0/3700129177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400d8c0 con 0x7fec84139b00 2022-05-02T09:39:20.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 -- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec84139b00 msgr2=0x7fec8405b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec84139b00 0x7fec8405b8a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fec74002f70 tx=0x7fec74006df0).stop 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 -- 172.21.15.50:0/3700129177 shutdown_connections 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec8405d7d0 0x7fec841402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 --2- 172.21.15.50:0/3700129177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec84139b00 0x7fec8405b8a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.152+0000 7fec8a79d700 1 -- 172.21.15.50:0/3700129177 >> 172.21.15.50:0/3700129177 conn(0x7fec840669d0 msgr2=0x7fec840a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.153+0000 7fec8a79d700 1 -- 172.21.15.50:0/3700129177 shutdown_connections 2022-05-02T09:39:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.153+0000 7fec8a79d700 1 -- 172.21.15.50:0/3700129177 wait complete. 2022-05-02T09:39:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.155+0000 7fec8a79d700 1 Processor -- start 2022-05-02T09:39:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.155+0000 7fec8a79d700 1 -- start start 2022-05-02T09:39:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 0x7fec84148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fec84139b00 0x7fec84145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840a49b0 con 0x7fec8405d7d0 2022-05-02T09:39:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840a3260 con 0x7fec84139720 2022-05-02T09:39:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8a79d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec84149880 con 0x7fec84139b00 2022-05-02T09:39:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec88f9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec88f9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50270/0 (socket says 172.21.15.50:50270) 2022-05-02T09:39:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec88f9a700 1 -- 172.21.15.50:0/1944515416 learned_addr learned my addr 172.21.15.50:0/1944515416 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec8979b700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 0x7fec84148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.156+0000 7fec89f9c700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fec84139b00 0x7fec84145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 -- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fec84139b00 msgr2=0x7fec84145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fec84139b00 0x7fec84145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 -- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 msgr2=0x7fec84148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 0x7fec84148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 -- 172.21.15.50:0/1944515416 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009530 con 0x7fec84139720 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec8979b700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 0x7fec84148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.157+0000 7fec88f9a700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec74002f70 tx=0x7fec74014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.158+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec74013e90 con 0x7fec84139720 2022-05-02T09:39:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.158+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7401e400 con 0x7fec84139720 2022-05-02T09:39:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.158+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7400b180 con 0x7fec84139720 2022-05-02T09:39:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.158+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7401e760 con 0x7fec84139720 2022-05-02T09:39:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.158+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec840a2d50 con 0x7fec84139720 2022-05-02T09:39:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.160+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84057990 con 0x7fec84139720 2022-05-02T09:39:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.160+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fec74025030 con 0x7fec84139720 2022-05-02T09:39:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.160+0000 7f7da7dff700 1 Processor -- start 2022-05-02T09:39:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.161+0000 7f7da7dff700 1 -- start start 2022-05-02T09:39:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.161+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fec7404b300 con 0x7fec84139720 2022-05-02T09:39:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da7dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 0x7f7da00a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da7dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da7dff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da0092440 con 0x7f7da00a40a0 2022-05-02T09:39:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da7dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da00a45a0 con 0x7f7da00a4d30 2022-05-02T09:39:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da7dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da00a4840 con 0x7f7da0097df0 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da5b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 0x7f7da00a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da639c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.163+0000 7f7da539a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7da00a40a0 0x7f7da013d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52180/0 (socket says 172.21.15.50:52180) 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da639c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49590/0 (socket says 172.21.15.50:49590) 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da5b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 0x7f7da00a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50272/0 (socket says 172.21.15.50:50272) 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da539a700 1 -- 172.21.15.50:0/772319798 learned_addr learned my addr 172.21.15.50:0/772319798 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da639c700 1 -- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 msgr2=0x7f7da00a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da639c700 1 --2- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 0x7f7da00a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da639c700 1 -- 172.21.15.50:0/772319798 >> v1:172.21.15.50:6789/0 conn(0x7f7da00a40a0 legacy=0x7f7da013d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.164+0000 7f7da639c700 1 -- 172.21.15.50:0/772319798 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00a5600 con 0x7f7da0097df0 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.165+0000 7f7da639c700 1 --2- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7d980032f0 tx=0x7f7d980091d0).ready entity=mon.2 client_cookie=dbd84057b573136f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.165+0000 7f7da4b99700 1 -- 172.21.15.50:0/772319798 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d9800b6c0 con 0x7f7da0097df0 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.165+0000 7f7da4b99700 1 -- 172.21.15.50:0/772319798 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800b820 con 0x7f7da0097df0 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.165+0000 7f7da4b99700 1 -- 172.21.15.50:0/772319798 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d9800b990 con 0x7f7da0097df0 2022-05-02T09:39:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.165+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec74028440 con 0x7fec84139720 2022-05-02T09:39:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 -- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 msgr2=0x7f7da013de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 --2- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7d980032f0 tx=0x7f7d980091d0).stop 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 -- 172.21.15.50:0/772319798 shutdown_connections 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 --2- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da0097df0 0x7f7da013de70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 --2- 172.21.15.50:0/772319798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da00a4d30 0x7f7da00a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 -- 172.21.15.50:0/772319798 >> 172.21.15.50:0/772319798 conn(0x7f7da00a7e80 msgr2=0x7f7da00a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 -- 172.21.15.50:0/772319798 shutdown_connections 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.166+0000 7f7da7dff700 1 -- 172.21.15.50:0/772319798 wait complete. 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.168+0000 7f7da7dff700 1 Processor -- start 2022-05-02T09:39:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.168+0000 7f7da7dff700 1 -- start start 2022-05-02T09:39:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 0x7f7da014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da00a4d30 0x7f7da00644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0064210 con 0x7f7da00a4d30 2022-05-02T09:39:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0065380 con 0x7f7da0097df0 2022-05-02T09:39:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da7dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0063710 con 0x7f7da00a40a0 2022-05-02T09:39:20.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da539a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da5b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 0x7f7da014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da539a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49592/0 (socket says 172.21.15.50:49592) 2022-05-02T09:39:20.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da539a700 1 -- 172.21.15.50:0/2634787361 learned_addr learned my addr 172.21.15.50:0/2634787361 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:20.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.170+0000 7f7da639c700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da00a4d30 0x7f7da00644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da539a700 1 -- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 msgr2=0x7f7da014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da539a700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 0x7f7da014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da539a700 1 -- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da00a4d30 msgr2=0x7f7da00644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da539a700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da00a4d30 0x7f7da00644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da539a700 1 -- 172.21.15.50:0/2634787361 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98009470 con 0x7f7da00a40a0 2022-05-02T09:39:20.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.171+0000 7f7da5b9b700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 0x7f7da014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:20.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7da539a700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7da00a58c0 tx=0x7f7d90007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d900070d0 con 0x7f7da00a40a0 2022-05-02T09:39:20.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90007230 con 0x7f7da00a40a0 2022-05-02T09:39:20.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7da7dff700 1 -- 172.21.15.50:0/2634787361 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da0066050 con 0x7f7da00a40a0 2022-05-02T09:39:20.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d90005610 con 0x7f7da00a40a0 2022-05-02T09:39:20.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.172+0000 7f7da7dff700 1 -- 172.21.15.50:0/2634787361 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da014d110 con 0x7f7da00a40a0 2022-05-02T09:39:20.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.174+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da00990e0 con 0x7f7da00a40a0 2022-05-02T09:39:20.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.175+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f7d90010070 con 0x7f7da00a40a0 2022-05-02T09:39:20.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.176+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7d90049880 con 0x7f7da00a40a0 2022-05-02T09:39:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.181+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7d9002e8b0 con 0x7f7da00a40a0 2022-05-02T09:39:20.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.202+0000 7f6d0639d700 1 Processor -- start 2022-05-02T09:39:20.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.202+0000 7f6d0639d700 1 -- start start 2022-05-02T09:39:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.203+0000 7f6d0639d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d0005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.203+0000 7f6d0639d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 0x7f6d001402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d0639d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0005d360 con 0x7f6d00139b00 2022-05-02T09:39:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d0639d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d00139010 con 0x7f6d0005d7d0 2022-05-02T09:39:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d0639d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001392d0 con 0x7f6d00139720 2022-05-02T09:39:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d0539b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d0005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d04b9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d00139b00 0x7f6d0005cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52182/0 (socket says 172.21.15.50:52182) 2022-05-02T09:39:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d04b9a700 1 -- 172.21.15.50:0/1400377043 learned_addr learned my addr 172.21.15.50:0/1400377043 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.204+0000 7f6d05b9c700 1 --2- 172.21.15.50:0/1400377043 >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 0x7f6d001402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d0539b700 1 -- 172.21.15.50:0/1400377043 >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 msgr2=0x7f6d001402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d0539b700 1 --2- 172.21.15.50:0/1400377043 >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 0x7f6d001402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d0539b700 1 -- 172.21.15.50:0/1400377043 >> v1:172.21.15.50:6789/0 conn(0x7f6d00139b00 legacy=0x7f6d0005cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d0539b700 1 -- 172.21.15.50:0/1400377043 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000a7c50 con 0x7f6d00139720 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d05b9c700 1 --2- 172.21.15.50:0/1400377043 >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 0x7f6d001402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.205+0000 7f6d0539b700 1 --2- 172.21.15.50:0/1400377043 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d0005b8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6cfc002f70 tx=0x7f6cfc006df0).ready entity=mon.2 client_cookie=bc8f507c579fc818 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6ceffff700 1 -- 172.21.15.50:0/1400377043 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cfc00d570 con 0x7f6d00139720 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6ceffff700 1 -- 172.21.15.50:0/1400377043 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc000e90 con 0x7f6d00139720 2022-05-02T09:39:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6ceffff700 1 -- 172.21.15.50:0/1400377043 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cfc00d8c0 con 0x7f6d00139720 2022-05-02T09:39:20.210 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6d0639d700 1 -- 172.21.15.50:0/1400377043 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 msgr2=0x7f6d0005b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6d0639d700 1 --2- 172.21.15.50:0/1400377043 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d0005b8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6cfc002f70 tx=0x7f6cfc006df0).stop 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.206+0000 7f6d0639d700 1 -- 172.21.15.50:0/1400377043 shutdown_connections 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.207+0000 7f6d0639d700 1 --2- 172.21.15.50:0/1400377043 >> v2:172.21.15.50:3300/0 conn(0x7f6d0005d7d0 0x7f6d001402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.207+0000 7f6d0639d700 1 --2- 172.21.15.50:0/1400377043 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d0005b8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.207+0000 7f6d0639d700 1 -- 172.21.15.50:0/1400377043 >> 172.21.15.50:0/1400377043 conn(0x7f6d000669d0 msgr2=0x7f6d000a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.207+0000 7f6d0639d700 1 -- 172.21.15.50:0/1400377043 shutdown_connections 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.207+0000 7f6d0639d700 1 -- 172.21.15.50:0/1400377043 wait complete. 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.208+0000 7f6d0639d700 1 Processor -- start 2022-05-02T09:39:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.208+0000 7f6d0639d700 1 -- start start 2022-05-02T09:39:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d00145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 0x7f6d000a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001462a0 con 0x7f6d0005d7d0 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000a2320 con 0x7f6d00139b00 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0639d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d00146000 con 0x7f6d00139720 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d04b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d00145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35696/0 (socket says 172.21.15.50:35696) 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.209+0000 7f6d0539b700 1 -- 172.21.15.50:0/3132930300 learned_addr learned my addr 172.21.15.50:0/3132930300 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d05b9c700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 0x7f6d000a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 -- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 msgr2=0x7f6d00145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d00145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 -- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 msgr2=0x7f6d000a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 0x7f6d000a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 -- 172.21.15.50:0/3132930300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009470 con 0x7f6d0005d7d0 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d05b9c700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 0x7f6d000a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.210+0000 7f6d0539b700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6cfc002f70 tx=0x7f6cfc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.211+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cfc013e90 con 0x7f6d0005d7d0 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.211+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc01e400 con 0x7f6d0005d7d0 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.211+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cfc01e760 con 0x7f6d0005d7d0 2022-05-02T09:39:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.211+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc00b180 con 0x7f6d0005d7d0 2022-05-02T09:39:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.211+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d000a4270 con 0x7f6d0005d7d0 2022-05-02T09:39:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.213+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d00057990 con 0x7f6d0005d7d0 2022-05-02T09:39:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.213+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f6cfc025030 con 0x7f6d0005d7d0 2022-05-02T09:39:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.214+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6cfc04b3a0 con 0x7f6d0005d7d0 2022-05-02T09:39:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.215+0000 7fef1659d700 1 Processor -- start 2022-05-02T09:39:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.215+0000 7fef1659d700 1 -- start start 2022-05-02T09:39:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.217+0000 7fef1659d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 0x7fef1005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.217+0000 7fef1659d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef1005d7d0 0x7fef101402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.217+0000 7fef1659d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1005d360 con 0x7fef10139b00 2022-05-02T09:39:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.217+0000 7fef1659d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef10139010 con 0x7fef1005d7d0 2022-05-02T09:39:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.217+0000 7fef1659d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef101392d0 con 0x7fef10139720 2022-05-02T09:39:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.218+0000 7fef1559b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 0x7fef1005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.218+0000 7fef14d9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef10139b00 0x7fef1005cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52184/0 (socket says 172.21.15.50:52184) 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.218+0000 7fef14d9a700 1 -- 172.21.15.50:0/3390836145 learned_addr learned my addr 172.21.15.50:0/3390836145 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.218+0000 7fef15d9c700 1 --2- 172.21.15.50:0/3390836145 >> v2:172.21.15.50:3300/0 conn(0x7fef1005d7d0 0x7fef101402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef15d9c700 1 -- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 msgr2=0x7fef1005b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef15d9c700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 0x7fef1005b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef15d9c700 1 -- 172.21.15.50:0/3390836145 >> v1:172.21.15.50:6789/0 conn(0x7fef10139b00 legacy=0x7fef1005cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef15d9c700 1 -- 172.21.15.50:0/3390836145 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100a7c50 con 0x7fef1005d7d0 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef1559b700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 0x7fef1005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7fef15d9c700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1005d7d0 0x7fef101402a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fef080032f0 tx=0x7fef080091d0).ready entity=mon.0 client_cookie=6314746f1b8022f6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6cfc028440 con 0x7f6d0005d7d0 2022-05-02T09:39:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7feefffff700 1 -- 172.21.15.50:0/3390836145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0800b6c0 con 0x7fef1005d7d0 2022-05-02T09:39:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7feefffff700 1 -- 172.21.15.50:0/3390836145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0800b820 con 0x7fef1005d7d0 2022-05-02T09:39:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.219+0000 7feefffff700 1 -- 172.21.15.50:0/3390836145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0800b990 con 0x7fef1005d7d0 2022-05-02T09:39:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.220+0000 7fef1659d700 1 -- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1005d7d0 msgr2=0x7fef101402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.220+0000 7fef1659d700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1005d7d0 0x7fef101402a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fef080032f0 tx=0x7fef080091d0).stop 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 -- 172.21.15.50:0/3390836145 shutdown_connections 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1005d7d0 0x7fef101402a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 --2- 172.21.15.50:0/3390836145 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139720 0x7fef1005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 -- 172.21.15.50:0/3390836145 >> 172.21.15.50:0/3390836145 conn(0x7fef100669d0 msgr2=0x7fef100a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 -- 172.21.15.50:0/3390836145 shutdown_connections 2022-05-02T09:39:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.221+0000 7fef1659d700 1 -- 172.21.15.50:0/3390836145 wait complete. 2022-05-02T09:39:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.223+0000 7fef1659d700 1 Processor -- start 2022-05-02T09:39:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.223+0000 7fef1659d700 1 -- start start 2022-05-02T09:39:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 0x7fef10132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 0x7fef1012bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139b00 0x7fef1012c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100a6430 con 0x7fef10139720 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100a65a0 con 0x7fef1005d7d0 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.224+0000 7fef1659d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef100a1e00 con 0x7fef10139b00 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef1559b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 0x7fef10132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef14d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 0x7fef1012bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef1559b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 0x7fef10132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50278/0 (socket says 172.21.15.50:50278) 2022-05-02T09:39:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef1559b700 1 -- 172.21.15.50:0/487138973 learned_addr learned my addr 172.21.15.50:0/487138973 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:20.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef15d9c700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139b00 0x7fef1012c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef14d9a700 1 -- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139b00 msgr2=0x7fef1012c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef14d9a700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139b00 0x7fef1012c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.225+0000 7fef14d9a700 1 -- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 msgr2=0x7fef10132890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7fef14d9a700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 0x7fef10132890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7fef14d9a700 1 -- 172.21.15.50:0/487138973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c00b180 con 0x7fef10139720 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7fef14d9a700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 0x7fef1012bdf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fef100a8b00 tx=0x7fef00007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef000070d0 con 0x7fef10139720 2022-05-02T09:39:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef00007230 con 0x7fef10139720 2022-05-02T09:39:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef00005610 con 0x7fef10139720 2022-05-02T09:39:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.226+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef08009470 con 0x7fef10139720 2022-05-02T09:39:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.227+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef100a26c0 con 0x7fef10139720 2022-05-02T09:39:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.228+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef100a6750 con 0x7fef10139720 2022-05-02T09:39:20.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.228+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fef00010070 con 0x7fef10139720 2022-05-02T09:39:20.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.229+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fef000496d0 con 0x7fef10139720 2022-05-02T09:39:20.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.233+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fef100a6750 con 0x7fef10139720 2022-05-02T09:39:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.308+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec84061b40 con 0x7fec84139720 2022-05-02T09:39:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.308+0000 7fec727fc700 1 -- 172.21.15.50:0/1944515416 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec74023030 con 0x7fec84139720 2022-05-02T09:39:20.311 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.310+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 >> v1:172.21.15.50:6800/30011 conn(0x7fec64038940 legacy=0x7fec6403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.310+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 msgr2=0x7fec84145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.310+0000 7fec8a79d700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec74002f70 tx=0x7fec74014000).stop 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 shutdown_connections 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fec84139b00 0x7fec84145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec8405d7d0 0x7fec84148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 --2- 172.21.15.50:0/1944515416 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec84139720 0x7fec84145460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 >> 172.21.15.50:0/1944515416 conn(0x7fec840669d0 msgr2=0x7fec8406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 shutdown_connections 2022-05-02T09:39:20.314 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.311+0000 7fec8a79d700 1 -- 172.21.15.50:0/1944515416 wait complete. 2022-05-02T09:39:20.321 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.319+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7da0057990 con 0x7f7da00a40a0 2022-05-02T09:39:20.321 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.319+0000 7f7d8effd700 1 -- 172.21.15.50:0/2634787361 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d90020020 con 0x7f7da00a40a0 2022-05-02T09:39:20.322 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:20.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 >> v1:172.21.15.50:6800/30011 conn(0x7f7d80038940 legacy=0x7f7d8003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 msgr2=0x7f7da0065b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7da00a58c0 tx=0x7f7d90007c10).stop 2022-05-02T09:39:20.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 shutdown_connections 2022-05-02T09:39:20.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da00a4d30 0x7f7da00644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7da0097df0 0x7f7da014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 --2- 172.21.15.50:0/2634787361 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7da00a40a0 0x7f7da0065b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.321+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 >> 172.21.15.50:0/2634787361 conn(0x7f7da00a7e80 msgr2=0x7f7da006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.322+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 shutdown_connections 2022-05-02T09:39:20.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.322+0000 7f7d7effd700 1 -- 172.21.15.50:0/2634787361 wait complete. 2022-05-02T09:39:20.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2022-05-02T09:39:20.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2022-05-02T09:39:20.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.417+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d00061b40 con 0x7f6d0005d7d0 2022-05-02T09:39:20.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.417+0000 7f6cee7fc700 1 -- 172.21.15.50:0/3132930300 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cfc023030 con 0x7f6d0005d7d0 2022-05-02T09:39:20.420 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 >> v1:172.21.15.50:6800/30011 conn(0x7f6ce0038a60 legacy=0x7f6ce003af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 msgr2=0x7f6d000a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6cfc002f70 tx=0x7f6cfc014000).stop 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 shutdown_connections 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d00139b00 0x7f6d000a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0005d7d0 0x7f6d000a4fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 --2- 172.21.15.50:0/3132930300 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6d00139720 0x7f6d00145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 >> 172.21.15.50:0/3132930300 conn(0x7f6d000669d0 msgr2=0x7f6d001359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 shutdown_connections 2022-05-02T09:39:20.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.419+0000 7f6d0639d700 1 -- 172.21.15.50:0/3132930300 wait complete. 2022-05-02T09:39:20.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.428+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef100a6750 con 0x7fef10139720 2022-05-02T09:39:20.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.428+0000 7feefe7fc700 1 -- 172.21.15.50:0/487138973 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef100a6750 con 0x7fef10139720 2022-05-02T09:39:20.431 INFO:teuthology.orchestra.run.smithi050.stdout:42949672965 2022-05-02T09:39:20.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 >> v1:172.21.15.50:6800/30011 conn(0x7feef0038940 legacy=0x7feef003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 msgr2=0x7fef1012bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 0x7fef1012bdf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fef100a8b00 tx=0x7fef00007b80).stop 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 shutdown_connections 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fef10139b00 0x7fef1012c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fef1005d7d0 0x7fef10132890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 --2- 172.21.15.50:0/487138973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef10139720 0x7fef1012bdf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 >> 172.21.15.50:0/487138973 conn(0x7fef100669d0 msgr2=0x7fef101337d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 shutdown_connections 2022-05-02T09:39:20.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:20.430+0000 7fef1659d700 1 -- 172.21.15.50:0/487138973 wait complete. 2022-05-02T09:39:20.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2022-05-02T09:39:20.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.0 2022-05-02T09:39:21.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:39:21.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:39:21.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:39:21.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:39:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.575+0000 7fda1b7ff700 1 Processor -- start 2022-05-02T09:39:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.575+0000 7fda1b7ff700 1 -- start start 2022-05-02T09:39:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.576+0000 7fda1b7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.576+0000 7fda1b7ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda1405d8d0 0x7fda1405cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1b7ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda14139450 con 0x7fda1405fca0 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1b7ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda14139710 con 0x7fda1405d8d0 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1b7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda1405bd60 con 0x7fda14139e80 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1959b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1959b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49602/0 (socket says 172.21.15.50:49602) 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda1959b700 1 -- 172.21.15.50:0/81832040 learned_addr learned my addr 172.21.15.50:0/81832040 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.577+0000 7fda18d9a700 1 --2- 172.21.15.50:0/81832040 >> v2:172.21.15.50:3300/0 conn(0x7fda1405d8d0 0x7fda1405cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.578+0000 7fda1959b700 1 -- 172.21.15.50:0/81832040 >> v2:172.21.15.50:3300/0 conn(0x7fda1405d8d0 msgr2=0x7fda1405cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.578+0000 7fda1959b700 1 --2- 172.21.15.50:0/81832040 >> v2:172.21.15.50:3300/0 conn(0x7fda1405d8d0 0x7fda1405cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.578+0000 7fda1959b700 1 -- 172.21.15.50:0/81832040 >> v1:172.21.15.50:6789/0 conn(0x7fda1405fca0 legacy=0x7fda14060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.578+0000 7fda1959b700 1 -- 172.21.15.50:0/81832040 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140a9970 con 0x7fda14139e80 2022-05-02T09:39:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.578+0000 7fda1959b700 1 --2- 172.21.15.50:0/81832040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fda10002f70 tx=0x7fda10006eb0).ready entity=mon.2 client_cookie=a9a18bff3358afe6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.579+0000 7fda03fff700 1 -- 172.21.15.50:0/81832040 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1000d5c0 con 0x7fda14139e80 2022-05-02T09:39:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.579+0000 7fda03fff700 1 -- 172.21.15.50:0/81832040 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10000e90 con 0x7fda14139e80 2022-05-02T09:39:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.579+0000 7fda03fff700 1 -- 172.21.15.50:0/81832040 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1000d950 con 0x7fda14139e80 2022-05-02T09:39:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 -- 172.21.15.50:0/81832040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 msgr2=0x7fda140a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/81832040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fda10002f70 tx=0x7fda10006eb0).stop 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 -- 172.21.15.50:0/81832040 shutdown_connections 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/81832040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda140a9480 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/81832040 >> v2:172.21.15.50:3300/0 conn(0x7fda1405d8d0 0x7fda1405cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 -- 172.21.15.50:0/81832040 >> 172.21.15.50:0/81832040 conn(0x7fda14066b60 msgr2=0x7fda140a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 -- 172.21.15.50:0/81832040 shutdown_connections 2022-05-02T09:39:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.580+0000 7fda1b7ff700 1 -- 172.21.15.50:0/81832040 wait complete. 2022-05-02T09:39:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.582+0000 7fda1b7ff700 1 Processor -- start 2022-05-02T09:39:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.582+0000 7fda1b7ff700 1 -- start start 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 0x7fda141489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda14148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda141316c0 con 0x7fda1405fca0 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda14130b40 con 0x7fda1405d8d0 2022-05-02T09:39:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1b7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda14130e00 con 0x7fda14139e80 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1959b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1959b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50280/0 (socket says 172.21.15.50:50280) 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda1959b700 1 -- 172.21.15.50:0/2993642953 learned_addr learned my addr 172.21.15.50:0/2993642953 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.584+0000 7fda19d9c700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda14148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda19d9c700 1 -- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 msgr2=0x7fda141330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda19d9c700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda19d9c700 1 -- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 msgr2=0x7fda141489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda18d9a700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 0x7fda141489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda19d9c700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 0x7fda141489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda19d9c700 1 -- 172.21.15.50:0/2993642953 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1000b1e0 con 0x7fda14139e80 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda1959b700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.585+0000 7fda18d9a700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 0x7fda141489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda19d9c700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda14148e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fda140aae00 tx=0x7fda0c007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c00f470 con 0x7fda14139e80 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00f5d0 con 0x7fda14139e80 2022-05-02T09:39:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c00f930 con 0x7fda14139e80 2022-05-02T09:39:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda14135400 con 0x7fda14139e80 2022-05-02T09:39:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.586+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda14132c10 con 0x7fda14139e80 2022-05-02T09:39:21.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.588+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fda0c010070 con 0x7fda14139e80 2022-05-02T09:39:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.588+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda14132de0 con 0x7fda14139e80 2022-05-02T09:39:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.588+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fda0c0498d0 con 0x7fda14139e80 2022-05-02T09:39:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.595+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fda14132de0 con 0x7fda14139e80 2022-05-02T09:39:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.626+0000 7fb53ed9d700 1 Processor -- start 2022-05-02T09:39:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.627+0000 7fb53ed9d700 1 -- start start 2022-05-02T09:39:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb538139720 0x7fb53805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53ed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 0x7fb5381402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53ed9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53805d360 con 0x7fb538139b00 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53ed9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb538139010 con 0x7fb538139720 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53ed9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381392d0 con 0x7fb53805d7d0 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb538139720 0x7fb53805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53d59a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb538139b00 0x7fb53805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52188/0 (socket says 172.21.15.50:52188) 2022-05-02T09:39:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53d59a700 1 -- 172.21.15.50:0/1060419513 learned_addr learned my addr 172.21.15.50:0/1060419513 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.628+0000 7fb53e59c700 1 --2- 172.21.15.50:0/1060419513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 0x7fb5381402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.629+0000 7fb53e59c700 1 -- 172.21.15.50:0/1060419513 >> v2:172.21.15.50:3300/0 conn(0x7fb538139720 msgr2=0x7fb53805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.629+0000 7fb53e59c700 1 --2- 172.21.15.50:0/1060419513 >> v2:172.21.15.50:3300/0 conn(0x7fb538139720 0x7fb53805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.629+0000 7fb53e59c700 1 -- 172.21.15.50:0/1060419513 >> v1:172.21.15.50:6789/0 conn(0x7fb538139b00 legacy=0x7fb53805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.629+0000 7fb53e59c700 1 -- 172.21.15.50:0/1060419513 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380a7c50 con 0x7fb53805d7d0 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.629+0000 7fb53e59c700 1 --2- 172.21.15.50:0/1060419513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 0x7fb5381402a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb528001110 tx=0x7fb5300091d0).ready entity=mon.1 client_cookie=60c6c6cab130c18c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.630+0000 7fb53cd99700 1 -- 172.21.15.50:0/1060419513 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53000b580 con 0x7fb53805d7d0 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.630+0000 7fb53cd99700 1 -- 172.21.15.50:0/1060419513 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53000b6e0 con 0x7fb53805d7d0 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.630+0000 7fb53cd99700 1 -- 172.21.15.50:0/1060419513 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53000b850 con 0x7fb53805d7d0 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.630+0000 7fb53ed9d700 1 -- 172.21.15.50:0/1060419513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 msgr2=0x7fb5381402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.630+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/1060419513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 0x7fb5381402a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb528001110 tx=0x7fb5300091d0).stop 2022-05-02T09:39:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 -- 172.21.15.50:0/1060419513 shutdown_connections 2022-05-02T09:39:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/1060419513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb53805d7d0 0x7fb5381402a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/1060419513 >> v2:172.21.15.50:3300/0 conn(0x7fb538139720 0x7fb53805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 -- 172.21.15.50:0/1060419513 >> 172.21.15.50:0/1060419513 conn(0x7fb5380669d0 msgr2=0x7fb5380a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 -- 172.21.15.50:0/1060419513 shutdown_connections 2022-05-02T09:39:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.631+0000 7fb53ed9d700 1 -- 172.21.15.50:0/1060419513 wait complete. 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.632+0000 7fb53ed9d700 1 Processor -- start 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.632+0000 7fb53ed9d700 1 -- start start 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 0x7fb53812e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53812ecb0 con 0x7fb538139720 2022-05-02T09:39:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380a4680 con 0x7fb538139b00 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53ed9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380a4940 con 0x7fb53805d7d0 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.633+0000 7fb53d59a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53dd9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53dd9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49606/0 (socket says 172.21.15.50:49606) 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53dd9b700 1 -- 172.21.15.50:0/2585120886 learned_addr learned my addr 172.21.15.50:0/2585120886 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35708/0 (socket says 172.21.15.50:35708) 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53e59c700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 0x7fb53812e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 -- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 msgr2=0x7fb5380a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 -- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 msgr2=0x7fb53812e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 0x7fb53812e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53d59a700 1 -- 172.21.15.50:0/2585120886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530009470 con 0x7fb538139720 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53dd9b700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.634+0000 7fb53e59c700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 0x7fb53812e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb53d59a700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb5280011d0 tx=0x7fb528007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52800ce40 con 0x7fb538139720 2022-05-02T09:39:21.641 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5280072e0 con 0x7fb538139720 2022-05-02T09:39:21.641 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380a42d0 con 0x7fb538139720 2022-05-02T09:39:21.641 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528005800 con 0x7fb538139720 2022-05-02T09:39:21.641 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.635+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381324b0 con 0x7fb538139720 2022-05-02T09:39:21.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.637+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5380a3f20 con 0x7fb538139720 2022-05-02T09:39:21.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.638+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fb52801a060 con 0x7fb538139720 2022-05-02T09:39:21.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.638+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb528049c50 con 0x7fb538139720 2022-05-02T09:39:21.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.642+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb52802ecc0 con 0x7fb538139720 2022-05-02T09:39:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.687+0000 7fb2ff1ff700 1 Processor -- start 2022-05-02T09:39:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.688+0000 7fb2ff1ff700 1 -- start start 2022-05-02T09:39:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2ff1ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f8139e80 0x7fb2f80a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2ff1ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 0x7fb2f8140a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2ff1ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f8139450 con 0x7fb2f805d8d0 2022-05-02T09:39:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2ff1ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f805d4f0 con 0x7fb2f8139e80 2022-05-02T09:39:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2ff1ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8139710 con 0x7fb2f813e660 2022-05-02T09:39:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2f7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2f805d8d0 0x7fb2f805cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52190/0 (socket says 172.21.15.50:52190) 2022-05-02T09:39:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2f7fff700 1 -- 172.21.15.50:0/2415835534 learned_addr learned my addr 172.21.15.50:0/2415835534 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.689+0000 7fb2fd79c700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 0x7fb2f8140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fcf9b700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f8139e80 0x7fb2f80a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fd79c700 1 -- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f8139e80 msgr2=0x7fb2f80a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fd79c700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f8139e80 0x7fb2f80a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fd79c700 1 -- 172.21.15.50:0/2415835534 >> v1:172.21.15.50:6789/0 conn(0x7fb2f805d8d0 legacy=0x7fb2f805cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2f77fe700 1 -- 172.21.15.50:0/2415835534 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403079069 0 0) 0x7fb2f8139450 con 0x7fb2f805d8d0 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fd79c700 1 -- 172.21.15.50:0/2415835534 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f805bd60 con 0x7fb2f813e660 2022-05-02T09:39:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.690+0000 7fb2fd79c700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 0x7fb2f8140a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb2f00032f0 tx=0x7fb2f00091d0).ready entity=mon.2 client_cookie=fcb816d1c0e7e411 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.691+0000 7fb2f77fe700 1 -- 172.21.15.50:0/2415835534 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f000b840 con 0x7fb2f813e660 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.691+0000 7fb2f77fe700 1 -- 172.21.15.50:0/2415835534 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000b9a0 con 0x7fb2f813e660 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.691+0000 7fb2f77fe700 1 -- 172.21.15.50:0/2415835534 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f000bb10 con 0x7fb2f813e660 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.691+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 msgr2=0x7fb2f8140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.691+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 0x7fb2f8140a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb2f00032f0 tx=0x7fb2f00091d0).stop 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/2415835534 shutdown_connections 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f813e660 0x7fb2f8140a50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/2415835534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f8139e80 0x7fb2f80a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/2415835534 >> 172.21.15.50:0/2415835534 conn(0x7fb2f8066b60 msgr2=0x7fb2f80a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/2415835534 shutdown_connections 2022-05-02T09:39:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.692+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/2415835534 wait complete. 2022-05-02T09:39:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.693+0000 7fb2ff1ff700 1 Processor -- start 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.693+0000 7fb2ff1ff700 1 -- start start 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f8139e80 0x7fb2f812b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f813e660 0x7fb2f812b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f812be70 con 0x7fb2f805d8d0 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f813ca70 con 0x7fb2f813e660 2022-05-02T09:39:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.694+0000 7fb2ff1ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f813cd30 con 0x7fb2f8139e80 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35710/0 (socket says 172.21.15.50:35710) 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 -- 172.21.15.50:0/1656706722 learned_addr learned my addr 172.21.15.50:0/1656706722 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2f7fff700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f8139e80 0x7fb2f812b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fd79c700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f813e660 0x7fb2f812b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 -- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f8139e80 msgr2=0x7fb2f812b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f8139e80 0x7fb2f812b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 -- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f813e660 msgr2=0x7fb2f812b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f813e660 0x7fb2f812b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 -- 172.21.15.50:0/1656706722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009470 con 0x7fb2f805d8d0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.695+0000 7fb2fcf9b700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb2ec0030b0 tx=0x7fb2ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.696+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec011780 con 0x7fb2f805d8d0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.696+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec0118e0 con 0x7fb2f805d8d0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.696+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec011c40 con 0x7fb2f805d8d0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.696+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f813c1d0 con 0x7fb2f805d8d0 2022-05-02T09:39:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.696+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f80a7c20 con 0x7fb2f805d8d0 2022-05-02T09:39:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.697+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fb2ec012420 con 0x7fb2f805d8d0 2022-05-02T09:39:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.698+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb2ec04a1e0 con 0x7fb2f805d8d0 2022-05-02T09:39:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.698+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80a9970 con 0x7fb2f805d8d0 2022-05-02T09:39:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.705+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb2ec02f210 con 0x7fb2f805d8d0 2022-05-02T09:39:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.744+0000 7f838df9d700 1 Processor -- start 2022-05-02T09:39:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.744+0000 7f838df9d700 1 -- start start 2022-05-02T09:39:21.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.745+0000 7f838df9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 0x7f838805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838df9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8388139b00 0x7f838805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838df9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8388139010 con 0x7f838805cc50 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838df9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83881392d0 con 0x7f8388139b00 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838df9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83880a7c50 con 0x7f8388139720 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838d79c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f838805cc50 0x7f838805fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52192/0 (socket says 172.21.15.50:52192) 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838cf9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 0x7f838805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f838d79c700 1 -- 172.21.15.50:0/3451342349 learned_addr learned my addr 172.21.15.50:0/3451342349 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:21.749 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.746+0000 7f8387fff700 1 --2- 172.21.15.50:0/3451342349 >> v2:172.21.15.50:3300/0 conn(0x7f8388139b00 0x7f838805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f83877fe700 1 -- 172.21.15.50:0/3451342349 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022660696 0 0) 0x7f8388139010 con 0x7f838805cc50 2022-05-02T09:39:21.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f83877fe700 1 -- 172.21.15.50:0/3451342349 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c003260 con 0x7f838805cc50 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f8387fff700 1 -- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 msgr2=0x7f838805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f8387fff700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 0x7f838805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f8387fff700 1 -- 172.21.15.50:0/3451342349 >> v1:172.21.15.50:6789/0 conn(0x7f838805cc50 legacy=0x7f838805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f8387fff700 1 -- 172.21.15.50:0/3451342349 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880a95d0 con 0x7f8388139b00 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.747+0000 7f838cf9b700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 0x7f838805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.748+0000 7f8387fff700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139b00 0x7f838805d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8374002f70 tx=0x7f8374006df0).ready entity=mon.0 client_cookie=20d2a3fcc6ce4174 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.748+0000 7f83877fe700 1 -- 172.21.15.50:0/3451342349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f837400d4a0 con 0x7f8388139b00 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.748+0000 7f83877fe700 1 -- 172.21.15.50:0/3451342349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374000e90 con 0x7f8388139b00 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.748+0000 7f83877fe700 1 -- 172.21.15.50:0/3451342349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f837400d7f0 con 0x7f8388139b00 2022-05-02T09:39:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 -- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139b00 msgr2=0x7f838805d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139b00 0x7f838805d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8374002f70 tx=0x7f8374006df0).stop 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 -- 172.21.15.50:0/3451342349 shutdown_connections 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8388139720 0x7f838805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 --2- 172.21.15.50:0/3451342349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139b00 0x7f838805d7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 -- 172.21.15.50:0/3451342349 >> 172.21.15.50:0/3451342349 conn(0x7f83880669d0 msgr2=0x7f83880a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 -- 172.21.15.50:0/3451342349 shutdown_connections 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.749+0000 7f838df9d700 1 -- 172.21.15.50:0/3451342349 wait complete. 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.751+0000 7f838df9d700 1 Processor -- start 2022-05-02T09:39:21.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.751+0000 7f838df9d700 1 -- start start 2022-05-02T09:39:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 0x7f838812c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8388139b00 0x7f83881487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388132940 con 0x7f8388139720 2022-05-02T09:39:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880a0f70 con 0x7f8388139b00 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.752+0000 7f838df9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838812cb30 con 0x7f838805cc50 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f838cf9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f838cf9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49614/0 (socket says 172.21.15.50:49614) 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f838cf9b700 1 -- 172.21.15.50:0/713545602 learned_addr learned my addr 172.21.15.50:0/713545602 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 0x7f838812c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f838d79c700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8388139b00 0x7f83881487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 -- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 msgr2=0x7f838812c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 -- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8388139b00 msgr2=0x7f83881487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8388139b00 0x7f83881487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f8387fff700 1 -- 172.21.15.50:0/713545602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c00b180 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.753+0000 7f838cf9b700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f8387fff700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 0x7f838812c640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8374002f70 tx=0x7f8374014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8374013d50 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837401e400 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f837401e760 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837400b180 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.754+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880a0630 con 0x7f8388139720 2022-05-02T09:39:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.756+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f837401c070 con 0x7f8388139720 2022-05-02T09:39:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.756+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f837404ae20 con 0x7f8388139720 2022-05-02T09:39:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.756+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8388057990 con 0x7f8388139720 2022-05-02T09:39:21.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.763+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f83740201a0 con 0x7f8388139720 2022-05-02T09:39:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.785+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb538132700 con 0x7fb538139720 2022-05-02T09:39:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.785+0000 7fb526ffd700 1 -- 172.21.15.50:0/2585120886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb528018030 con 0x7fb538139720 2022-05-02T09:39:21.788 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:21.791 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.787+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 >> v1:172.21.15.50:6800/30011 conn(0x7fb5180389d0 legacy=0x7fb51803ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.787+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 msgr2=0x7fb53812e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.787+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb5280011d0 tx=0x7fb528007b50).stop 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 shutdown_connections 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb53805d7d0 0x7fb5380a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb538139b00 0x7fb53812e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 --2- 172.21.15.50:0/2585120886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb538139720 0x7fb53812e2d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 >> 172.21.15.50:0/2585120886 conn(0x7fb5380669d0 msgr2=0x7fb53806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 shutdown_connections 2022-05-02T09:39:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.788+0000 7fb53ed9d700 1 -- 172.21.15.50:0/2585120886 wait complete. 2022-05-02T09:39:21.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.796+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda14132de0 con 0x7fda14139e80 2022-05-02T09:39:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.796+0000 7fda027fc700 1 -- 172.21.15.50:0/2993642953 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda14132de0 con 0x7fda14139e80 2022-05-02T09:39:21.799 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 >> v1:172.21.15.50:6800/30011 conn(0x7fd9f40389d0 legacy=0x7fd9f403ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 msgr2=0x7fda14148e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda14148e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fda140aae00 tx=0x7fda0c007eb0).stop 2022-05-02T09:39:21.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 shutdown_connections 2022-05-02T09:39:21.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fda14139e80 0x7fda14148e90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda1405d8d0 0x7fda141330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 --2- 172.21.15.50:0/2993642953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda1405fca0 0x7fda141489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.799+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 >> 172.21.15.50:0/2993642953 conn(0x7fda14066b60 msgr2=0x7fda14060150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.800+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 shutdown_connections 2022-05-02T09:39:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.800+0000 7fda1b7ff700 1 -- 172.21.15.50:0/2993642953 wait complete. 2022-05-02T09:39:21.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2022-05-02T09:39:21.815 DEBUG:teuthology.parallel:result is None 2022-05-02T09:39:21.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2022-05-02T09:39:21.839 DEBUG:teuthology.parallel:result is None 2022-05-02T09:39:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.840+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2f8057990 con 0x7fb2f805d8d0 2022-05-02T09:39:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.841+0000 7fb2f5ffb700 1 -- 172.21.15.50:0/1656706722 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2ec029090 con 0x7fb2f805d8d0 2022-05-02T09:39:21.843 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:21.846 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 >> v1:172.21.15.50:6800/30011 conn(0x7fb2d8038a60 legacy=0x7fb2d803af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.846 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 msgr2=0x7fb2f813a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.846 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb2ec0030b0 tx=0x7fb2ec008040).stop 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 shutdown_connections 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2f813e660 0x7fb2f812b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f805d8d0 0x7fb2f813a640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 --2- 172.21.15.50:0/1656706722 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb2f8139e80 0x7fb2f812b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.843+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 >> 172.21.15.50:0/1656706722 conn(0x7fb2f8066b60 msgr2=0x7fb2f806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.844+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 shutdown_connections 2022-05-02T09:39:21.847 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.844+0000 7fb2ff1ff700 1 -- 172.21.15.50:0/1656706722 wait complete. 2022-05-02T09:39:21.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2022-05-02T09:39:21.883 DEBUG:teuthology.parallel:result is None 2022-05-02T09:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.927+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8388061b40 con 0x7f8388139720 2022-05-02T09:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.927+0000 7f8385ffb700 1 -- 172.21.15.50:0/713545602 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8374023020 con 0x7f8388139720 2022-05-02T09:39:21.930 INFO:teuthology.orchestra.run.smithi050.stdout:42949672966 2022-05-02T09:39:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 >> v1:172.21.15.50:6800/30011 conn(0x7f8368038a00 legacy=0x7f836803aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 msgr2=0x7f838812c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 0x7f838812c640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8374002f70 tx=0x7f8374014000).stop 2022-05-02T09:39:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 shutdown_connections 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f838805cc50 0x7f838812c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8388139b00 0x7f83881487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 --2- 172.21.15.50:0/713545602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388139720 0x7f838812c640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 >> 172.21.15.50:0/713545602 conn(0x7f83880669d0 msgr2=0x7f83880aac80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 shutdown_connections 2022-05-02T09:39:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:21.929+0000 7f838df9d700 1 -- 172.21.15.50:0/713545602 wait complete. 2022-05-02T09:39:21.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2022-05-02T09:39:21.956 DEBUG:teuthology.parallel:result is None 2022-05-02T09:39:21.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-05-02T09:39:21.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:39:22.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.160+0000 7f122179d700 1 Processor -- start 2022-05-02T09:39:22.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.160+0000 7f122179d700 1 -- start start 2022-05-02T09:39:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c139010 con 0x7f121c139720 2022-05-02T09:39:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c1392d0 con 0x7f121c139b00 2022-05-02T09:39:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f122179d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0a7c50 con 0x7f121c05cc50 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f1220f9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f121bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.161+0000 7f121b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50292/0 (socket says 172.21.15.50:50292) 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 -- 172.21.15.50:0/3880393187 learned_addr learned my addr 172.21.15.50:0/3880393187 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35716/0 (socket says 172.21.15.50:35716) 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f1220f9c700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49616/0 (socket says 172.21.15.50:49616) 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 -- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 msgr2=0x7f121c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 -- 172.21.15.50:0/3880393187 >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 msgr2=0x7f121c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 --2- 172.21.15.50:0/3880393187 >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 -- 172.21.15.50:0/3880393187 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0a95d0 con 0x7f121c139b00 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f1220f9c700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121bfff700 1 --2- 172.21.15.50:0/3880393187 >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.162+0000 7f121b7fe700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1210002f70 tx=0x7f1210006eb0).ready entity=mon.1 client_cookie=ba4b6a12f1172ec6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f121affd700 1 -- 172.21.15.50:0/3880393187 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f121000d570 con 0x7f121c139b00 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f121affd700 1 -- 172.21.15.50:0/3880393187 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210000e90 con 0x7f121c139b00 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f121affd700 1 -- 172.21.15.50:0/3880393187 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f121000d900 con 0x7f121c139b00 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 -- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 msgr2=0x7f121c05d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1210002f70 tx=0x7f1210006eb0).stop 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 -- 172.21.15.50:0/3880393187 shutdown_connections 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c05cc50 0x7f121c05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 --2- 172.21.15.50:0/3880393187 >> v2:172.21.15.50:3300/0 conn(0x7f121c139720 0x7f121c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 --2- 172.21.15.50:0/3880393187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139b00 0x7f121c05d7d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 -- 172.21.15.50:0/3880393187 >> 172.21.15.50:0/3880393187 conn(0x7f121c0669d0 msgr2=0x7f121c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:22.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 -- 172.21.15.50:0/3880393187 shutdown_connections 2022-05-02T09:39:22.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.163+0000 7f122179d700 1 -- 172.21.15.50:0/3880393187 wait complete. 2022-05-02T09:39:22.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.165+0000 7f122179d700 1 Processor -- start 2022-05-02T09:39:22.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.165+0000 7f122179d700 1 -- start start 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 0x7f121c12e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c139b00 0x7f121c12e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c132c40 con 0x7f121c05cc50 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0a3820 con 0x7f121c139720 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f122179d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0608e0 con 0x7f121c139b00 2022-05-02T09:39:22.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.166+0000 7f121bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35718/0 (socket says 172.21.15.50:35718) 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 -- 172.21.15.50:0/3396508017 learned_addr learned my addr 172.21.15.50:0/3396508017 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121b7fe700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 0x7f121c12e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f1220f9c700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c139b00 0x7f121c12e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 -- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c139b00 msgr2=0x7f121c12e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c139b00 0x7f121c12e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 -- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 msgr2=0x7f121c12e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 0x7f121c12e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 -- 172.21.15.50:0/3396508017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009470 con 0x7f121c05cc50 2022-05-02T09:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121b7fe700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 0x7f121c12e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.167+0000 7f121bfff700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f120c00c000 tx=0x7f120c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.168+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f120c00c6a0 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.168+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00c800 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.168+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f120c00cb60 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.168+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c00b180 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.168+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121000b1e0 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.169+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f120c00ccc0 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.169+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c0a4150 con 0x7f121c05cc50 2022-05-02T09:39:22.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.169+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f120c04a980 con 0x7f121c05cc50 2022-05-02T09:39:22.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.173+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f120c0333e0 con 0x7f121c05cc50 2022-05-02T09:39:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.297+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 --> v1:172.21.15.50:6800/30011 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f121c0a33e0 con 0x7f11fc038940 2022-05-02T09:39:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.305+0000 7f12197fa700 1 -- 172.21.15.50:0/3396508017 <== mgr.4101 v1:172.21.15.50:6800/30011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246918 (unknown 2965378022 0 919559145) 0x7f1210006940 con 0x7f11fc038940 2022-05-02T09:39:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.308+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 >> v1:172.21.15.50:6800/30011 conn(0x7f11fc038940 legacy=0x7f11fc03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 msgr2=0x7f121c0a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f120c00c000 tx=0x7f120c006df0).stop 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 shutdown_connections 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f121c139b00 0x7f121c12e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f121c05cc50 0x7f121c0a4300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 --2- 172.21.15.50:0/3396508017 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f121c139720 0x7f121c12e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 >> 172.21.15.50:0/3396508017 conn(0x7f121c0669d0 msgr2=0x7f121c12f790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 shutdown_connections 2022-05-02T09:39:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.309+0000 7f122179d700 1 -- 172.21.15.50:0/3396508017 wait complete. 2022-05-02T09:39:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:39:22.335 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2022-05-02T09:39:20.329894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":219350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.021881"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355153+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:11.355153+0000","last_peered":"2022-05-02T09:39:11.355153+0000","last_clean":"2022-05-02T09:39:11.355153+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:11.355153+0000","last_undegraded":"2022-05-02T09:39:11.355153+0000","last_fullsized":"2022-05-02T09:39:11.355153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368500+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:11.368500+0000","last_peered":"2022-05-02T09:39:11.368500+0000","last_clean":"2022-05-02T09:39:11.368500+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:11.368500+0000","last_undegraded":"2022-05-02T09:39:11.368500+0000","last_fullsized":"2022-05-02T09:39:11.368500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369629+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:11.369629+0000","last_peered":"2022-05-02T09:39:11.369629+0000","last_clean":"2022-05-02T09:39:11.369629+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:11.369629+0000","last_undegraded":"2022-05-02T09:39:11.369629+0000","last_fullsized":"2022-05-02T09:39:11.369629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365329+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:11.365329+0000","last_peered":"2022-05-02T09:39:11.365329+0000","last_clean":"2022-05-02T09:39:11.365329+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:11.365329+0000","last_undegraded":"2022-05-02T09:39:11.365329+0000","last_fullsized":"2022-05-02T09:39:11.365329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.352892+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:11.352892+0000","last_peered":"2022-05-02T09:39:11.352892+0000","last_clean":"2022-05-02T09:39:11.352892+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:11.352892+0000","last_undegraded":"2022-05-02T09:39:11.352892+0000","last_fullsized":"2022-05-02T09:39:11.352892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336375+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:11.336375+0000","last_peered":"2022-05-02T09:39:11.336375+0000","last_clean":"2022-05-02T09:39:11.336375+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:11.336375+0000","last_undegraded":"2022-05-02T09:39:11.336375+0000","last_fullsized":"2022-05-02T09:39:11.336375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360099+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:11.360099+0000","last_peered":"2022-05-02T09:39:11.360099+0000","last_clean":"2022-05-02T09:39:11.360099+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:11.360099+0000","last_undegraded":"2022-05-02T09:39:11.360099+0000","last_fullsized":"2022-05-02T09:39:11.360099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369652+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:11.369652+0000","last_peered":"2022-05-02T09:39:11.369652+0000","last_clean":"2022-05-02T09:39:11.369652+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:11.369652+0000","last_undegraded":"2022-05-02T09:39:11.369652+0000","last_fullsized":"2022-05-02T09:39:11.369652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357350+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:11.357350+0000","last_peered":"2022-05-02T09:39:11.357350+0000","last_clean":"2022-05-02T09:39:11.357350+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:11.357350+0000","last_undegraded":"2022-05-02T09:39:11.357350+0000","last_fullsized":"2022-05-02T09:39:11.357350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367445+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:11.367445+0000","last_peered":"2022-05-02T09:39:11.367445+0000","last_clean":"2022-05-02T09:39:11.367445+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:11.367445+0000","last_undegraded":"2022-05-02T09:39:11.367445+0000","last_fullsized":"2022-05-02T09:39:11.367445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368889+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:11.368889+0000","last_peered":"2022-05-02T09:39:11.368889+0000","last_clean":"2022-05-02T09:39:11.368889+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:11.368889+0000","last_undegraded":"2022-05-02T09:39:11.368889+0000","last_fullsized":"2022-05-02T09:39:11.368889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357571+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:11.357571+0000","last_peered":"2022-05-02T09:39:11.357571+0000","last_clean":"2022-05-02T09:39:11.357571+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:11.357571+0000","last_undegraded":"2022-05-02T09:39:11.357571+0000","last_fullsized":"2022-05-02T09:39:11.357571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355213+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:11.355213+0000","last_peered":"2022-05-02T09:39:11.355213+0000","last_clean":"2022-05-02T09:39:11.355213+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:11.355213+0000","last_undegraded":"2022-05-02T09:39:11.355213+0000","last_fullsized":"2022-05-02T09:39:11.355213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360530+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:11.360530+0000","last_peered":"2022-05-02T09:39:11.360530+0000","last_clean":"2022-05-02T09:39:11.360530+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:11.360530+0000","last_undegraded":"2022-05-02T09:39:11.360530+0000","last_fullsized":"2022-05-02T09:39:11.360530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365433+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:11.365433+0000","last_peered":"2022-05-02T09:39:11.365433+0000","last_clean":"2022-05-02T09:39:11.365433+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:11.365433+0000","last_undegraded":"2022-05-02T09:39:11.365433+0000","last_fullsized":"2022-05-02T09:39:11.365433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354550+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:11.354550+0000","last_peered":"2022-05-02T09:39:11.354550+0000","last_clean":"2022-05-02T09:39:11.354550+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:11.354550+0000","last_undegraded":"2022-05-02T09:39:11.354550+0000","last_fullsized":"2022-05-02T09:39:11.354550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357327+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:11.357327+0000","last_peered":"2022-05-02T09:39:11.357327+0000","last_clean":"2022-05-02T09:39:11.357327+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:11.357327+0000","last_undegraded":"2022-05-02T09:39:11.357327+0000","last_fullsized":"2022-05-02T09:39:11.357327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365430+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:11.365430+0000","last_peered":"2022-05-02T09:39:11.365430+0000","last_clean":"2022-05-02T09:39:11.365430+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:11.365430+0000","last_undegraded":"2022-05-02T09:39:11.365430+0000","last_fullsized":"2022-05-02T09:39:11.365430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.356788+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:11.356788+0000","last_peered":"2022-05-02T09:39:11.356788+0000","last_clean":"2022-05-02T09:39:11.356788+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:11.356788+0000","last_undegraded":"2022-05-02T09:39:11.356788+0000","last_fullsized":"2022-05-02T09:39:11.356788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367056+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:11.367056+0000","last_peered":"2022-05-02T09:39:11.367056+0000","last_clean":"2022-05-02T09:39:11.367056+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:11.367056+0000","last_undegraded":"2022-05-02T09:39:11.367056+0000","last_fullsized":"2022-05-02T09:39:11.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366274+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:11.366274+0000","last_peered":"2022-05-02T09:39:11.366274+0000","last_clean":"2022-05-02T09:39:11.366274+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:11.366274+0000","last_undegraded":"2022-05-02T09:39:11.366274+0000","last_fullsized":"2022-05-02T09:39:11.366274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365262+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:11.365262+0000","last_peered":"2022-05-02T09:39:11.365262+0000","last_clean":"2022-05-02T09:39:11.365262+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:11.365262+0000","last_undegraded":"2022-05-02T09:39:11.365262+0000","last_fullsized":"2022-05-02T09:39:11.365262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360079+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:11.360079+0000","last_peered":"2022-05-02T09:39:11.360079+0000","last_clean":"2022-05-02T09:39:11.360079+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:11.360079+0000","last_undegraded":"2022-05-02T09:39:11.360079+0000","last_fullsized":"2022-05-02T09:39:11.360079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360396+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:11.360396+0000","last_peered":"2022-05-02T09:39:11.360396+0000","last_clean":"2022-05-02T09:39:11.360396+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:11.360396+0000","last_undegraded":"2022-05-02T09:39:11.360396+0000","last_fullsized":"2022-05-02T09:39:11.360396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361409+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:11.361409+0000","last_peered":"2022-05-02T09:39:11.361409+0000","last_clean":"2022-05-02T09:39:11.361409+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:11.361409+0000","last_undegraded":"2022-05-02T09:39:11.361409+0000","last_fullsized":"2022-05-02T09:39:11.361409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367015+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:11.367015+0000","last_peered":"2022-05-02T09:39:11.367015+0000","last_clean":"2022-05-02T09:39:11.367015+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:11.367015+0000","last_undegraded":"2022-05-02T09:39:11.367015+0000","last_fullsized":"2022-05-02T09:39:11.367015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360228+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:11.360228+0000","last_peered":"2022-05-02T09:39:11.360228+0000","last_clean":"2022-05-02T09:39:11.360228+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:11.360228+0000","last_undegraded":"2022-05-02T09:39:11.360228+0000","last_fullsized":"2022-05-02T09:39:11.360228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360570+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:11.360570+0000","last_peered":"2022-05-02T09:39:11.360570+0000","last_clean":"2022-05-02T09:39:11.360570+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:11.360570+0000","last_undegraded":"2022-05-02T09:39:11.360570+0000","last_fullsized":"2022-05-02T09:39:11.360570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374260+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:11.374260+0000","last_peered":"2022-05-02T09:39:11.374260+0000","last_clean":"2022-05-02T09:39:11.374260+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:11.374260+0000","last_undegraded":"2022-05-02T09:39:11.374260+0000","last_fullsized":"2022-05-02T09:39:11.374260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312943+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:11.312943+0000","last_peered":"2022-05-02T09:39:11.312943+0000","last_clean":"2022-05-02T09:39:11.312943+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:11.312943+0000","last_undegraded":"2022-05-02T09:39:11.312943+0000","last_fullsized":"2022-05-02T09:39:11.312943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369975+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:11.369975+0000","last_peered":"2022-05-02T09:39:11.369975+0000","last_clean":"2022-05-02T09:39:11.369975+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:11.369975+0000","last_undegraded":"2022-05-02T09:39:11.369975+0000","last_fullsized":"2022-05-02T09:39:11.369975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175205+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:13.175205+0000","last_peered":"2022-05-02T09:39:13.175205+0000","last_clean":"2022-05-02T09:39:13.175205+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:13.175205+0000","last_undegraded":"2022-05-02T09:39:13.175205+0000","last_fullsized":"2022-05-02T09:39:13.175205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374280+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:11.374280+0000","last_peered":"2022-05-02T09:39:11.374280+0000","last_clean":"2022-05-02T09:39:11.374280+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:11.374280+0000","last_undegraded":"2022-05-02T09:39:11.374280+0000","last_fullsized":"2022-05-02T09:39:11.374280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349121+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:39:14.349121+0000","last_peered":"2022-05-02T09:39:14.349121+0000","last_clean":"2022-05-02T09:39:14.349121+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:39:14.349121+0000","last_undegraded":"2022-05-02T09:39:14.349121+0000","last_fullsized":"2022-05-02T09:39:14.349121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.342612+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:11.342612+0000","last_peered":"2022-05-02T09:39:11.342612+0000","last_clean":"2022-05-02T09:39:11.342612+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:11.342612+0000","last_undegraded":"2022-05-02T09:39:11.342612+0000","last_fullsized":"2022-05-02T09:39:11.342612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:14.347064+0000","last_peered":"2022-05-02T09:39:14.347064+0000","last_clean":"2022-05-02T09:39:14.347064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:14.347064+0000","last_undegraded":"2022-05-02T09:39:14.347064+0000","last_fullsized":"2022-05-02T09:39:14.347064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360056+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:11.360056+0000","last_peered":"2022-05-02T09:39:11.360056+0000","last_clean":"2022-05-02T09:39:11.360056+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:11.360056+0000","last_undegraded":"2022-05-02T09:39:11.360056+0000","last_fullsized":"2022-05-02T09:39:11.360056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312107+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:12.312107+0000","last_peered":"2022-05-02T09:39:12.312107+0000","last_clean":"2022-05-02T09:39:12.312107+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:12.312107+0000","last_undegraded":"2022-05-02T09:39:12.312107+0000","last_fullsized":"2022-05-02T09:39:12.312107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366331+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:11.366331+0000","last_peered":"2022-05-02T09:39:11.366331+0000","last_clean":"2022-05-02T09:39:11.366331+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:11.366331+0000","last_undegraded":"2022-05-02T09:39:11.366331+0000","last_fullsized":"2022-05-02T09:39:11.366331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346844+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:39:14.346844+0000","last_peered":"2022-05-02T09:39:14.346844+0000","last_clean":"2022-05-02T09:39:14.346844+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:39:14.346844+0000","last_undegraded":"2022-05-02T09:39:14.346844+0000","last_fullsized":"2022-05-02T09:39:14.346844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355173+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:11.355173+0000","last_peered":"2022-05-02T09:39:11.355173+0000","last_clean":"2022-05-02T09:39:11.355173+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:11.355173+0000","last_undegraded":"2022-05-02T09:39:11.355173+0000","last_fullsized":"2022-05-02T09:39:11.355173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346940+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:14.346940+0000","last_peered":"2022-05-02T09:39:14.346940+0000","last_clean":"2022-05-02T09:39:14.346940+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:14.346940+0000","last_undegraded":"2022-05-02T09:39:14.346940+0000","last_fullsized":"2022-05-02T09:39:14.346940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374300+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:11.374300+0000","last_peered":"2022-05-02T09:39:11.374300+0000","last_clean":"2022-05-02T09:39:11.374300+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:11.374300+0000","last_undegraded":"2022-05-02T09:39:11.374300+0000","last_fullsized":"2022-05-02T09:39:11.374300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347966+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:14.347966+0000","last_peered":"2022-05-02T09:39:14.347966+0000","last_clean":"2022-05-02T09:39:14.347966+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:14.347966+0000","last_undegraded":"2022-05-02T09:39:14.347966+0000","last_fullsized":"2022-05-02T09:39:14.347966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360201+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:11.360201+0000","last_peered":"2022-05-02T09:39:11.360201+0000","last_clean":"2022-05-02T09:39:11.360201+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:11.360201+0000","last_undegraded":"2022-05-02T09:39:11.360201+0000","last_fullsized":"2022-05-02T09:39:11.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313705+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:11.313705+0000","last_peered":"2022-05-02T09:39:11.313705+0000","last_clean":"2022-05-02T09:39:11.313705+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:11.313705+0000","last_undegraded":"2022-05-02T09:39:11.313705+0000","last_fullsized":"2022-05-02T09:39:11.313705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357485+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:11.357485+0000","last_peered":"2022-05-02T09:39:11.357485+0000","last_clean":"2022-05-02T09:39:11.357485+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:11.357485+0000","last_undegraded":"2022-05-02T09:39:11.357485+0000","last_fullsized":"2022-05-02T09:39:11.357485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.344885+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:14.344885+0000","last_peered":"2022-05-02T09:39:14.344885+0000","last_clean":"2022-05-02T09:39:14.344885+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:14.344885+0000","last_undegraded":"2022-05-02T09:39:14.344885+0000","last_fullsized":"2022-05-02T09:39:14.344885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374217+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:11.374217+0000","last_peered":"2022-05-02T09:39:11.374217+0000","last_clean":"2022-05-02T09:39:11.374217+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:11.374217+0000","last_undegraded":"2022-05-02T09:39:11.374217+0000","last_fullsized":"2022-05-02T09:39:11.374217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368927+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:11.368927+0000","last_peered":"2022-05-02T09:39:11.368927+0000","last_clean":"2022-05-02T09:39:11.368927+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:11.368927+0000","last_undegraded":"2022-05-02T09:39:11.368927+0000","last_fullsized":"2022-05-02T09:39:11.368927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.373265+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:11.373265+0000","last_peered":"2022-05-02T09:39:11.373265+0000","last_clean":"2022-05-02T09:39:11.373265+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:11.373265+0000","last_undegraded":"2022-05-02T09:39:11.373265+0000","last_fullsized":"2022-05-02T09:39:11.373265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.348885+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:11.348885+0000","last_peered":"2022-05-02T09:39:11.348885+0000","last_clean":"2022-05-02T09:39:11.348885+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:11.348885+0000","last_undegraded":"2022-05-02T09:39:11.348885+0000","last_fullsized":"2022-05-02T09:39:11.348885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360401+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:11.360401+0000","last_peered":"2022-05-02T09:39:11.360401+0000","last_clean":"2022-05-02T09:39:11.360401+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:11.360401+0000","last_undegraded":"2022-05-02T09:39:11.360401+0000","last_fullsized":"2022-05-02T09:39:11.360401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.372713+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:11.372713+0000","last_peered":"2022-05-02T09:39:11.372713+0000","last_clean":"2022-05-02T09:39:11.372713+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:11.372713+0000","last_undegraded":"2022-05-02T09:39:11.372713+0000","last_fullsized":"2022-05-02T09:39:11.372713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357412+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:11.357412+0000","last_peered":"2022-05-02T09:39:11.357412+0000","last_clean":"2022-05-02T09:39:11.357412+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:11.357412+0000","last_undegraded":"2022-05-02T09:39:11.357412+0000","last_fullsized":"2022-05-02T09:39:11.357412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.325992+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:11.325992+0000","last_peered":"2022-05-02T09:39:11.325992+0000","last_clean":"2022-05-02T09:39:11.325992+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:11.325992+0000","last_undegraded":"2022-05-02T09:39:11.325992+0000","last_fullsized":"2022-05-02T09:39:11.325992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365391+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:11.365391+0000","last_peered":"2022-05-02T09:39:11.365391+0000","last_clean":"2022-05-02T09:39:11.365391+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:11.365391+0000","last_undegraded":"2022-05-02T09:39:11.365391+0000","last_fullsized":"2022-05-02T09:39:11.365391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346299+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:14.346299+0000","last_peered":"2022-05-02T09:39:14.346299+0000","last_clean":"2022-05-02T09:39:14.346299+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:14.346299+0000","last_undegraded":"2022-05-02T09:39:14.346299+0000","last_fullsized":"2022-05-02T09:39:14.346299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347440+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:11.347440+0000","last_peered":"2022-05-02T09:39:11.347440+0000","last_clean":"2022-05-02T09:39:11.347440+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:11.347440+0000","last_undegraded":"2022-05-02T09:39:11.347440+0000","last_fullsized":"2022-05-02T09:39:11.347440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175949+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:13.175949+0000","last_peered":"2022-05-02T09:39:13.175949+0000","last_clean":"2022-05-02T09:39:13.175949+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:13.175949+0000","last_undegraded":"2022-05-02T09:39:13.175949+0000","last_fullsized":"2022-05-02T09:39:13.175949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374357+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:11.374357+0000","last_peered":"2022-05-02T09:39:11.374357+0000","last_clean":"2022-05-02T09:39:11.374357+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:11.374357+0000","last_undegraded":"2022-05-02T09:39:11.374357+0000","last_fullsized":"2022-05-02T09:39:11.374357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347002+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:14.347002+0000","last_peered":"2022-05-02T09:39:14.347002+0000","last_clean":"2022-05-02T09:39:14.347002+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:14.347002+0000","last_undegraded":"2022-05-02T09:39:14.347002+0000","last_fullsized":"2022-05-02T09:39:14.347002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357166+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:11.357166+0000","last_peered":"2022-05-02T09:39:11.357166+0000","last_clean":"2022-05-02T09:39:11.357166+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:11.357166+0000","last_undegraded":"2022-05-02T09:39:11.357166+0000","last_fullsized":"2022-05-02T09:39:11.357166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346745+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:14.346745+0000","last_peered":"2022-05-02T09:39:14.346745+0000","last_clean":"2022-05-02T09:39:14.346745+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:14.346745+0000","last_undegraded":"2022-05-02T09:39:14.346745+0000","last_fullsized":"2022-05-02T09:39:14.346745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361382+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:11.361382+0000","last_peered":"2022-05-02T09:39:11.361382+0000","last_clean":"2022-05-02T09:39:11.361382+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:11.361382+0000","last_undegraded":"2022-05-02T09:39:11.361382+0000","last_fullsized":"2022-05-02T09:39:11.361382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.321742+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:11.321742+0000","last_peered":"2022-05-02T09:39:11.321742+0000","last_clean":"2022-05-02T09:39:11.321742+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:11.321742+0000","last_undegraded":"2022-05-02T09:39:11.321742+0000","last_fullsized":"2022-05-02T09:39:11.321742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.309990+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:12.309990+0000","last_peered":"2022-05-02T09:39:12.309990+0000","last_clean":"2022-05-02T09:39:12.309990+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:12.309990+0000","last_undegraded":"2022-05-02T09:39:12.309990+0000","last_fullsized":"2022-05-02T09:39:12.309990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366309+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:11.366309+0000","last_peered":"2022-05-02T09:39:11.366309+0000","last_clean":"2022-05-02T09:39:11.366309+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:11.366309+0000","last_undegraded":"2022-05-02T09:39:11.366309+0000","last_fullsized":"2022-05-02T09:39:11.366309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313812+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:11.313812+0000","last_peered":"2022-05-02T09:39:11.313812+0000","last_clean":"2022-05-02T09:39:11.313812+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:11.313812+0000","last_undegraded":"2022-05-02T09:39:11.313812+0000","last_fullsized":"2022-05-02T09:39:11.313812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346586+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:14.346586+0000","last_peered":"2022-05-02T09:39:14.346586+0000","last_clean":"2022-05-02T09:39:14.346586+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:14.346586+0000","last_undegraded":"2022-05-02T09:39:14.346586+0000","last_fullsized":"2022-05-02T09:39:14.346586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361284+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:11.361284+0000","last_peered":"2022-05-02T09:39:11.361284+0000","last_clean":"2022-05-02T09:39:11.361284+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:11.361284+0000","last_undegraded":"2022-05-02T09:39:11.361284+0000","last_fullsized":"2022-05-02T09:39:11.361284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.316222+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:11.316222+0000","last_peered":"2022-05-02T09:39:11.316222+0000","last_clean":"2022-05-02T09:39:11.316222+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:11.316222+0000","last_undegraded":"2022-05-02T09:39:11.316222+0000","last_fullsized":"2022-05-02T09:39:11.316222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.737867+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:12.737867+0000","last_peered":"2022-05-02T09:39:12.737867+0000","last_clean":"2022-05-02T09:39:12.737867+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:12.737867+0000","last_undegraded":"2022-05-02T09:39:12.737867+0000","last_fullsized":"2022-05-02T09:39:12.737867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367748+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:11.367748+0000","last_peered":"2022-05-02T09:39:11.367748+0000","last_clean":"2022-05-02T09:39:11.367748+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:11.367748+0000","last_undegraded":"2022-05-02T09:39:11.367748+0000","last_fullsized":"2022-05-02T09:39:11.367748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313763+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:11.313763+0000","last_peered":"2022-05-02T09:39:11.313763+0000","last_clean":"2022-05-02T09:39:11.313763+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:11.313763+0000","last_undegraded":"2022-05-02T09:39:11.313763+0000","last_fullsized":"2022-05-02T09:39:11.313763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312314+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:11.312314+0000","last_peered":"2022-05-02T09:39:11.312314+0000","last_clean":"2022-05-02T09:39:11.312314+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:11.312314+0000","last_undegraded":"2022-05-02T09:39:11.312314+0000","last_fullsized":"2022-05-02T09:39:11.312314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313542+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:11.313542+0000","last_peered":"2022-05-02T09:39:11.313542+0000","last_clean":"2022-05-02T09:39:11.313542+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:11.313542+0000","last_undegraded":"2022-05-02T09:39:11.313542+0000","last_fullsized":"2022-05-02T09:39:11.313542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374380+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:11.374380+0000","last_peered":"2022-05-02T09:39:11.374380+0000","last_clean":"2022-05-02T09:39:11.374380+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:11.374380+0000","last_undegraded":"2022-05-02T09:39:11.374380+0000","last_fullsized":"2022-05-02T09:39:11.374380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312941+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:11.312941+0000","last_peered":"2022-05-02T09:39:11.312941+0000","last_clean":"2022-05-02T09:39:11.312941+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:11.312941+0000","last_undegraded":"2022-05-02T09:39:11.312941+0000","last_fullsized":"2022-05-02T09:39:11.312941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.311122+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:12.311122+0000","last_peered":"2022-05-02T09:39:12.311122+0000","last_clean":"2022-05-02T09:39:12.311122+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:12.311122+0000","last_undegraded":"2022-05-02T09:39:12.311122+0000","last_fullsized":"2022-05-02T09:39:12.311122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365451+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:11.365451+0000","last_peered":"2022-05-02T09:39:11.365451+0000","last_clean":"2022-05-02T09:39:11.365451+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:11.365451+0000","last_undegraded":"2022-05-02T09:39:11.365451+0000","last_fullsized":"2022-05-02T09:39:11.365451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.319431+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:11.319431+0000","last_peered":"2022-05-02T09:39:11.319431+0000","last_clean":"2022-05-02T09:39:11.319431+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:11.319431+0000","last_undegraded":"2022-05-02T09:39:11.319431+0000","last_fullsized":"2022-05-02T09:39:11.319431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.317299+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:11.317299+0000","last_peered":"2022-05-02T09:39:11.317299+0000","last_clean":"2022-05-02T09:39:11.317299+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:11.317299+0000","last_undegraded":"2022-05-02T09:39:11.317299+0000","last_fullsized":"2022-05-02T09:39:11.317299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365371+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:11.365371+0000","last_peered":"2022-05-02T09:39:11.365371+0000","last_clean":"2022-05-02T09:39:11.365371+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:11.365371+0000","last_undegraded":"2022-05-02T09:39:11.365371+0000","last_fullsized":"2022-05-02T09:39:11.365371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346024+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:14.346024+0000","last_peered":"2022-05-02T09:39:14.346024+0000","last_clean":"2022-05-02T09:39:14.346024+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:14.346024+0000","last_undegraded":"2022-05-02T09:39:14.346024+0000","last_fullsized":"2022-05-02T09:39:14.346024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.320945+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:11.320945+0000","last_peered":"2022-05-02T09:39:11.320945+0000","last_clean":"2022-05-02T09:39:11.320945+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:11.320945+0000","last_undegraded":"2022-05-02T09:39:11.320945+0000","last_fullsized":"2022-05-02T09:39:11.320945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374239+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:11.374239+0000","last_peered":"2022-05-02T09:39:11.374239+0000","last_clean":"2022-05-02T09:39:11.374239+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:11.374239+0000","last_undegraded":"2022-05-02T09:39:11.374239+0000","last_fullsized":"2022-05-02T09:39:11.374239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.314878+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:11.314878+0000","last_peered":"2022-05-02T09:39:11.314878+0000","last_clean":"2022-05-02T09:39:11.314878+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:11.314878+0000","last_undegraded":"2022-05-02T09:39:11.314878+0000","last_fullsized":"2022-05-02T09:39:11.314878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312697+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:12.312697+0000","last_peered":"2022-05-02T09:39:12.312697+0000","last_clean":"2022-05-02T09:39:12.312697+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:12.312697+0000","last_undegraded":"2022-05-02T09:39:12.312697+0000","last_fullsized":"2022-05-02T09:39:12.312697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.345426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:11.345426+0000","last_peered":"2022-05-02T09:39:11.345426+0000","last_clean":"2022-05-02T09:39:11.345426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:11.345426+0000","last_undegraded":"2022-05-02T09:39:11.345426+0000","last_fullsized":"2022-05-02T09:39:11.345426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349020+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:14.349020+0000","last_peered":"2022-05-02T09:39:14.349020+0000","last_clean":"2022-05-02T09:39:14.349020+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:14.349020+0000","last_undegraded":"2022-05-02T09:39:14.349020+0000","last_fullsized":"2022-05-02T09:39:14.349020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367944+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:11.367944+0000","last_peered":"2022-05-02T09:39:11.367944+0000","last_clean":"2022-05-02T09:39:11.367944+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:11.367944+0000","last_undegraded":"2022-05-02T09:39:11.367944+0000","last_fullsized":"2022-05-02T09:39:11.367944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361211+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:11.361211+0000","last_peered":"2022-05-02T09:39:11.361211+0000","last_clean":"2022-05-02T09:39:11.361211+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:11.361211+0000","last_undegraded":"2022-05-02T09:39:11.361211+0000","last_fullsized":"2022-05-02T09:39:11.361211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355195+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:11.355195+0000","last_peered":"2022-05-02T09:39:11.355195+0000","last_clean":"2022-05-02T09:39:11.355195+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:11.355195+0000","last_undegraded":"2022-05-02T09:39:11.355195+0000","last_fullsized":"2022-05-02T09:39:11.355195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354864+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:11.354864+0000","last_peered":"2022-05-02T09:39:11.354864+0000","last_clean":"2022-05-02T09:39:11.354864+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:11.354864+0000","last_undegraded":"2022-05-02T09:39:11.354864+0000","last_fullsized":"2022-05-02T09:39:11.354864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357437+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:11.357437+0000","last_peered":"2022-05-02T09:39:11.357437+0000","last_clean":"2022-05-02T09:39:11.357437+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:11.357437+0000","last_undegraded":"2022-05-02T09:39:11.357437+0000","last_fullsized":"2022-05-02T09:39:11.357437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347169+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:11.347169+0000","last_peered":"2022-05-02T09:39:11.347169+0000","last_clean":"2022-05-02T09:39:11.347169+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:11.347169+0000","last_undegraded":"2022-05-02T09:39:11.347169+0000","last_fullsized":"2022-05-02T09:39:11.347169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336363+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:11.336363+0000","last_peered":"2022-05-02T09:39:11.336363+0000","last_clean":"2022-05-02T09:39:11.336363+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:11.336363+0000","last_undegraded":"2022-05-02T09:39:11.336363+0000","last_fullsized":"2022-05-02T09:39:11.336363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369133+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:11.369133+0000","last_peered":"2022-05-02T09:39:11.369133+0000","last_clean":"2022-05-02T09:39:11.369133+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:11.369133+0000","last_undegraded":"2022-05-02T09:39:11.369133+0000","last_fullsized":"2022-05-02T09:39:11.369133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367896+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:11.367896+0000","last_peered":"2022-05-02T09:39:11.367896+0000","last_clean":"2022-05-02T09:39:11.367896+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:11.367896+0000","last_undegraded":"2022-05-02T09:39:11.367896+0000","last_fullsized":"2022-05-02T09:39:11.367896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360368+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:11.360368+0000","last_peered":"2022-05-02T09:39:11.360368+0000","last_clean":"2022-05-02T09:39:11.360368+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:11.360368+0000","last_undegraded":"2022-05-02T09:39:11.360368+0000","last_fullsized":"2022-05-02T09:39:11.360368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.346985+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:11.346985+0000","last_peered":"2022-05-02T09:39:11.346985+0000","last_clean":"2022-05-02T09:39:11.346985+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:11.346985+0000","last_undegraded":"2022-05-02T09:39:11.346985+0000","last_fullsized":"2022-05-02T09:39:11.346985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347483+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:11.347483+0000","last_peered":"2022-05-02T09:39:11.347483+0000","last_clean":"2022-05-02T09:39:11.347483+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:11.347483+0000","last_undegraded":"2022-05-02T09:39:11.347483+0000","last_fullsized":"2022-05-02T09:39:11.347483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374132+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:11.374132+0000","last_peered":"2022-05-02T09:39:11.374132+0000","last_clean":"2022-05-02T09:39:11.374132+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:11.374132+0000","last_undegraded":"2022-05-02T09:39:11.374132+0000","last_fullsized":"2022-05-02T09:39:11.374132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368847+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:11.368847+0000","last_peered":"2022-05-02T09:39:11.368847+0000","last_clean":"2022-05-02T09:39:11.368847+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:11.368847+0000","last_undegraded":"2022-05-02T09:39:11.368847+0000","last_fullsized":"2022-05-02T09:39:11.368847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":56079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}]}} 2022-05-02T09:39:22.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:39:22.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.581+0000 7f54381ff700 1 Processor -- start 2022-05-02T09:39:22.595 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.581+0000 7f54381ff700 1 -- start start 2022-05-02T09:39:22.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.582+0000 7f54381ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f543005d8d0 0x7f543005cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.582+0000 7f54381ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543013e660 0x7f5430140a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.582+0000 7f54381ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5430139450 con 0x7f5430139e80 2022-05-02T09:39:22.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.582+0000 7f54381ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5430139710 con 0x7f543005d8d0 2022-05-02T09:39:22.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.582+0000 7f54381ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543005bd60 con 0x7f543013e660 2022-05-02T09:39:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f543005d8d0 0x7f543005cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543679c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543013e660 0x7f5430140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f543005d8d0 0x7f543005cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35720/0 (socket says 172.21.15.50:35720) 2022-05-02T09:39:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 -- 172.21.15.50:0/3776132817 learned_addr learned my addr 172.21.15.50:0/3776132817 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 -- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543013e660 msgr2=0x7f5430140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 --2- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543013e660 0x7f5430140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 -- 172.21.15.50:0/3776132817 >> v1:172.21.15.50:6789/0 conn(0x7f5430139e80 legacy=0x7f54300a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.583+0000 7f543579a700 1 -- 172.21.15.50:0/3776132817 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300abf50 con 0x7f543005d8d0 2022-05-02T09:39:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f543579a700 1 --2- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543005d8d0 0x7f543005cde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5420002f70 tx=0x7f5420006eb0).ready entity=mon.0 client_cookie=f71fbd2dacff08ec server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f5434f99700 1 -- 172.21.15.50:0/3776132817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542000d570 con 0x7f543005d8d0 2022-05-02T09:39:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f5434f99700 1 -- 172.21.15.50:0/3776132817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420000e90 con 0x7f543005d8d0 2022-05-02T09:39:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f5434f99700 1 -- 172.21.15.50:0/3776132817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542000d900 con 0x7f543005d8d0 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 -- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543005d8d0 msgr2=0x7f543005cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 --2- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543005d8d0 0x7f543005cde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5420002f70 tx=0x7f5420006eb0).stop 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 -- 172.21.15.50:0/3776132817 shutdown_connections 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 --2- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543013e660 0x7f5430140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 --2- 172.21.15.50:0/3776132817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543005d8d0 0x7f543005cde0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.584+0000 7f54381ff700 1 -- 172.21.15.50:0/3776132817 >> 172.21.15.50:0/3776132817 conn(0x7f5430066b60 msgr2=0x7f54300a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.585+0000 7f54381ff700 1 -- 172.21.15.50:0/3776132817 shutdown_connections 2022-05-02T09:39:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.585+0000 7f54381ff700 1 -- 172.21.15.50:0/3776132817 wait complete. 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.586+0000 7f54381ff700 1 Processor -- start 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.586+0000 7f54381ff700 1 -- start start 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.587+0000 7f54381ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543005d8d0 0x7f543013ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.587+0000 7f54381ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f54381ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 0x7f543012b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f54381ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300a2800 con 0x7f543013e660 2022-05-02T09:39:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f54381ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543013a960 con 0x7f5430139e80 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f54381ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543013a640 con 0x7f543005d8d0 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50298/0 (socket says 172.21.15.50:50298) 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 -- 172.21.15.50:0/3379511084 learned_addr learned my addr 172.21.15.50:0/3379511084 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f5435f9b700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543005d8d0 0x7f543013ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543679c700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 0x7f543012b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 -- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543005d8d0 msgr2=0x7f543013ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543005d8d0 0x7f543013ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 -- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 msgr2=0x7f543012b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 0x7f543012b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543579a700 1 -- 172.21.15.50:0/3379511084 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542000b1e0 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.588+0000 7f543679c700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 0x7f543012b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f543579a700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5420002f70 tx=0x7f5420015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54200116e0 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420011840 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54300a3680 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5420011ba0 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.589+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543013c0d0 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.590+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f5420025030 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.590+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430057990 con 0x7f5430139e80 2022-05-02T09:39:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.591+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f542004b640 con 0x7f5430139e80 2022-05-02T09:39:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.594+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f542001e7e0 con 0x7f5430139e80 2022-05-02T09:39:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.715+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 --> v1:172.21.15.50:6800/30011 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54300ab0a0 con 0x7f5410038af0 2022-05-02T09:39:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.722+0000 7f541effd700 1 -- 172.21.15.50:0/3379511084 <== mgr.4101 v1:172.21.15.50:6800/30011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246932 (unknown 2965378022 0 956825443) 0x7f54300ab0a0 con 0x7f5410038af0 2022-05-02T09:39:22.728 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.725+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 >> v1:172.21.15.50:6800/30011 conn(0x7f5410038af0 legacy=0x7f541003afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 msgr2=0x7f543012b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5420002f70 tx=0x7f5420015000).stop 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 shutdown_connections 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f543005d8d0 0x7f543013ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543013e660 0x7f543012b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 --2- 172.21.15.50:0/3379511084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5430139e80 0x7f543012b030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 >> 172.21.15.50:0/3379511084 conn(0x7f5430066b60 msgr2=0x7f543013da40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:22.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 shutdown_connections 2022-05-02T09:39:22.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:22.726+0000 7f54381ff700 1 -- 172.21.15.50:0/3379511084 wait complete. 2022-05-02T09:39:22.732 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:39:22.751 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2022-05-02T09:39:22.330324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":219350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.022281"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355153+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:11.355153+0000","last_peered":"2022-05-02T09:39:11.355153+0000","last_clean":"2022-05-02T09:39:11.355153+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:11.355153+0000","last_undegraded":"2022-05-02T09:39:11.355153+0000","last_fullsized":"2022-05-02T09:39:11.355153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368500+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:11.368500+0000","last_peered":"2022-05-02T09:39:11.368500+0000","last_clean":"2022-05-02T09:39:11.368500+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:11.368500+0000","last_undegraded":"2022-05-02T09:39:11.368500+0000","last_fullsized":"2022-05-02T09:39:11.368500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369629+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:11.369629+0000","last_peered":"2022-05-02T09:39:11.369629+0000","last_clean":"2022-05-02T09:39:11.369629+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:11.369629+0000","last_undegraded":"2022-05-02T09:39:11.369629+0000","last_fullsized":"2022-05-02T09:39:11.369629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365329+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:11.365329+0000","last_peered":"2022-05-02T09:39:11.365329+0000","last_clean":"2022-05-02T09:39:11.365329+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:11.365329+0000","last_undegraded":"2022-05-02T09:39:11.365329+0000","last_fullsized":"2022-05-02T09:39:11.365329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.352892+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:11.352892+0000","last_peered":"2022-05-02T09:39:11.352892+0000","last_clean":"2022-05-02T09:39:11.352892+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:11.352892+0000","last_undegraded":"2022-05-02T09:39:11.352892+0000","last_fullsized":"2022-05-02T09:39:11.352892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336375+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:11.336375+0000","last_peered":"2022-05-02T09:39:11.336375+0000","last_clean":"2022-05-02T09:39:11.336375+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:11.336375+0000","last_undegraded":"2022-05-02T09:39:11.336375+0000","last_fullsized":"2022-05-02T09:39:11.336375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360099+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:11.360099+0000","last_peered":"2022-05-02T09:39:11.360099+0000","last_clean":"2022-05-02T09:39:11.360099+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:11.360099+0000","last_undegraded":"2022-05-02T09:39:11.360099+0000","last_fullsized":"2022-05-02T09:39:11.360099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369652+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:11.369652+0000","last_peered":"2022-05-02T09:39:11.369652+0000","last_clean":"2022-05-02T09:39:11.369652+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:11.369652+0000","last_undegraded":"2022-05-02T09:39:11.369652+0000","last_fullsized":"2022-05-02T09:39:11.369652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357350+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:11.357350+0000","last_peered":"2022-05-02T09:39:11.357350+0000","last_clean":"2022-05-02T09:39:11.357350+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:11.357350+0000","last_undegraded":"2022-05-02T09:39:11.357350+0000","last_fullsized":"2022-05-02T09:39:11.357350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367445+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:11.367445+0000","last_peered":"2022-05-02T09:39:11.367445+0000","last_clean":"2022-05-02T09:39:11.367445+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:11.367445+0000","last_undegraded":"2022-05-02T09:39:11.367445+0000","last_fullsized":"2022-05-02T09:39:11.367445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368889+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:11.368889+0000","last_peered":"2022-05-02T09:39:11.368889+0000","last_clean":"2022-05-02T09:39:11.368889+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:11.368889+0000","last_undegraded":"2022-05-02T09:39:11.368889+0000","last_fullsized":"2022-05-02T09:39:11.368889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357571+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:11.357571+0000","last_peered":"2022-05-02T09:39:11.357571+0000","last_clean":"2022-05-02T09:39:11.357571+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:11.357571+0000","last_undegraded":"2022-05-02T09:39:11.357571+0000","last_fullsized":"2022-05-02T09:39:11.357571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355213+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:11.355213+0000","last_peered":"2022-05-02T09:39:11.355213+0000","last_clean":"2022-05-02T09:39:11.355213+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:11.355213+0000","last_undegraded":"2022-05-02T09:39:11.355213+0000","last_fullsized":"2022-05-02T09:39:11.355213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360530+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:11.360530+0000","last_peered":"2022-05-02T09:39:11.360530+0000","last_clean":"2022-05-02T09:39:11.360530+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:11.360530+0000","last_undegraded":"2022-05-02T09:39:11.360530+0000","last_fullsized":"2022-05-02T09:39:11.360530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365433+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:11.365433+0000","last_peered":"2022-05-02T09:39:11.365433+0000","last_clean":"2022-05-02T09:39:11.365433+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:11.365433+0000","last_undegraded":"2022-05-02T09:39:11.365433+0000","last_fullsized":"2022-05-02T09:39:11.365433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354550+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:11.354550+0000","last_peered":"2022-05-02T09:39:11.354550+0000","last_clean":"2022-05-02T09:39:11.354550+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:11.354550+0000","last_undegraded":"2022-05-02T09:39:11.354550+0000","last_fullsized":"2022-05-02T09:39:11.354550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357327+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:11.357327+0000","last_peered":"2022-05-02T09:39:11.357327+0000","last_clean":"2022-05-02T09:39:11.357327+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:11.357327+0000","last_undegraded":"2022-05-02T09:39:11.357327+0000","last_fullsized":"2022-05-02T09:39:11.357327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365430+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:11.365430+0000","last_peered":"2022-05-02T09:39:11.365430+0000","last_clean":"2022-05-02T09:39:11.365430+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:11.365430+0000","last_undegraded":"2022-05-02T09:39:11.365430+0000","last_fullsized":"2022-05-02T09:39:11.365430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.356788+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:11.356788+0000","last_peered":"2022-05-02T09:39:11.356788+0000","last_clean":"2022-05-02T09:39:11.356788+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:11.356788+0000","last_undegraded":"2022-05-02T09:39:11.356788+0000","last_fullsized":"2022-05-02T09:39:11.356788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367056+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:11.367056+0000","last_peered":"2022-05-02T09:39:11.367056+0000","last_clean":"2022-05-02T09:39:11.367056+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:11.367056+0000","last_undegraded":"2022-05-02T09:39:11.367056+0000","last_fullsized":"2022-05-02T09:39:11.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366274+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:11.366274+0000","last_peered":"2022-05-02T09:39:11.366274+0000","last_clean":"2022-05-02T09:39:11.366274+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:11.366274+0000","last_undegraded":"2022-05-02T09:39:11.366274+0000","last_fullsized":"2022-05-02T09:39:11.366274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365262+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:11.365262+0000","last_peered":"2022-05-02T09:39:11.365262+0000","last_clean":"2022-05-02T09:39:11.365262+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:11.365262+0000","last_undegraded":"2022-05-02T09:39:11.365262+0000","last_fullsized":"2022-05-02T09:39:11.365262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360079+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:11.360079+0000","last_peered":"2022-05-02T09:39:11.360079+0000","last_clean":"2022-05-02T09:39:11.360079+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:11.360079+0000","last_undegraded":"2022-05-02T09:39:11.360079+0000","last_fullsized":"2022-05-02T09:39:11.360079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360396+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:11.360396+0000","last_peered":"2022-05-02T09:39:11.360396+0000","last_clean":"2022-05-02T09:39:11.360396+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:11.360396+0000","last_undegraded":"2022-05-02T09:39:11.360396+0000","last_fullsized":"2022-05-02T09:39:11.360396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361409+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:11.361409+0000","last_peered":"2022-05-02T09:39:11.361409+0000","last_clean":"2022-05-02T09:39:11.361409+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:11.361409+0000","last_undegraded":"2022-05-02T09:39:11.361409+0000","last_fullsized":"2022-05-02T09:39:11.361409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367015+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:11.367015+0000","last_peered":"2022-05-02T09:39:11.367015+0000","last_clean":"2022-05-02T09:39:11.367015+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:11.367015+0000","last_undegraded":"2022-05-02T09:39:11.367015+0000","last_fullsized":"2022-05-02T09:39:11.367015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360228+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:11.360228+0000","last_peered":"2022-05-02T09:39:11.360228+0000","last_clean":"2022-05-02T09:39:11.360228+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:11.360228+0000","last_undegraded":"2022-05-02T09:39:11.360228+0000","last_fullsized":"2022-05-02T09:39:11.360228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360570+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:11.360570+0000","last_peered":"2022-05-02T09:39:11.360570+0000","last_clean":"2022-05-02T09:39:11.360570+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:11.360570+0000","last_undegraded":"2022-05-02T09:39:11.360570+0000","last_fullsized":"2022-05-02T09:39:11.360570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374260+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:11.374260+0000","last_peered":"2022-05-02T09:39:11.374260+0000","last_clean":"2022-05-02T09:39:11.374260+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:11.374260+0000","last_undegraded":"2022-05-02T09:39:11.374260+0000","last_fullsized":"2022-05-02T09:39:11.374260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312943+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:11.312943+0000","last_peered":"2022-05-02T09:39:11.312943+0000","last_clean":"2022-05-02T09:39:11.312943+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:11.312943+0000","last_undegraded":"2022-05-02T09:39:11.312943+0000","last_fullsized":"2022-05-02T09:39:11.312943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369975+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:11.369975+0000","last_peered":"2022-05-02T09:39:11.369975+0000","last_clean":"2022-05-02T09:39:11.369975+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:11.369975+0000","last_undegraded":"2022-05-02T09:39:11.369975+0000","last_fullsized":"2022-05-02T09:39:11.369975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175205+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:13.175205+0000","last_peered":"2022-05-02T09:39:13.175205+0000","last_clean":"2022-05-02T09:39:13.175205+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:13.175205+0000","last_undegraded":"2022-05-02T09:39:13.175205+0000","last_fullsized":"2022-05-02T09:39:13.175205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374280+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:11.374280+0000","last_peered":"2022-05-02T09:39:11.374280+0000","last_clean":"2022-05-02T09:39:11.374280+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:11.374280+0000","last_undegraded":"2022-05-02T09:39:11.374280+0000","last_fullsized":"2022-05-02T09:39:11.374280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349121+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:39:14.349121+0000","last_peered":"2022-05-02T09:39:14.349121+0000","last_clean":"2022-05-02T09:39:14.349121+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:39:14.349121+0000","last_undegraded":"2022-05-02T09:39:14.349121+0000","last_fullsized":"2022-05-02T09:39:14.349121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.342612+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:11.342612+0000","last_peered":"2022-05-02T09:39:11.342612+0000","last_clean":"2022-05-02T09:39:11.342612+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:11.342612+0000","last_undegraded":"2022-05-02T09:39:11.342612+0000","last_fullsized":"2022-05-02T09:39:11.342612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:14.347064+0000","last_peered":"2022-05-02T09:39:14.347064+0000","last_clean":"2022-05-02T09:39:14.347064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:14.347064+0000","last_undegraded":"2022-05-02T09:39:14.347064+0000","last_fullsized":"2022-05-02T09:39:14.347064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360056+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:11.360056+0000","last_peered":"2022-05-02T09:39:11.360056+0000","last_clean":"2022-05-02T09:39:11.360056+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:11.360056+0000","last_undegraded":"2022-05-02T09:39:11.360056+0000","last_fullsized":"2022-05-02T09:39:11.360056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312107+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:12.312107+0000","last_peered":"2022-05-02T09:39:12.312107+0000","last_clean":"2022-05-02T09:39:12.312107+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:12.312107+0000","last_undegraded":"2022-05-02T09:39:12.312107+0000","last_fullsized":"2022-05-02T09:39:12.312107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366331+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:11.366331+0000","last_peered":"2022-05-02T09:39:11.366331+0000","last_clean":"2022-05-02T09:39:11.366331+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:11.366331+0000","last_undegraded":"2022-05-02T09:39:11.366331+0000","last_fullsized":"2022-05-02T09:39:11.366331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346844+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:39:14.346844+0000","last_peered":"2022-05-02T09:39:14.346844+0000","last_clean":"2022-05-02T09:39:14.346844+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:39:14.346844+0000","last_undegraded":"2022-05-02T09:39:14.346844+0000","last_fullsized":"2022-05-02T09:39:14.346844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355173+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:11.355173+0000","last_peered":"2022-05-02T09:39:11.355173+0000","last_clean":"2022-05-02T09:39:11.355173+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:11.355173+0000","last_undegraded":"2022-05-02T09:39:11.355173+0000","last_fullsized":"2022-05-02T09:39:11.355173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346940+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:14.346940+0000","last_peered":"2022-05-02T09:39:14.346940+0000","last_clean":"2022-05-02T09:39:14.346940+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:14.346940+0000","last_undegraded":"2022-05-02T09:39:14.346940+0000","last_fullsized":"2022-05-02T09:39:14.346940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374300+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:11.374300+0000","last_peered":"2022-05-02T09:39:11.374300+0000","last_clean":"2022-05-02T09:39:11.374300+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:11.374300+0000","last_undegraded":"2022-05-02T09:39:11.374300+0000","last_fullsized":"2022-05-02T09:39:11.374300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347966+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:14.347966+0000","last_peered":"2022-05-02T09:39:14.347966+0000","last_clean":"2022-05-02T09:39:14.347966+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:14.347966+0000","last_undegraded":"2022-05-02T09:39:14.347966+0000","last_fullsized":"2022-05-02T09:39:14.347966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360201+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:11.360201+0000","last_peered":"2022-05-02T09:39:11.360201+0000","last_clean":"2022-05-02T09:39:11.360201+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:11.360201+0000","last_undegraded":"2022-05-02T09:39:11.360201+0000","last_fullsized":"2022-05-02T09:39:11.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313705+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:11.313705+0000","last_peered":"2022-05-02T09:39:11.313705+0000","last_clean":"2022-05-02T09:39:11.313705+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:11.313705+0000","last_undegraded":"2022-05-02T09:39:11.313705+0000","last_fullsized":"2022-05-02T09:39:11.313705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357485+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:11.357485+0000","last_peered":"2022-05-02T09:39:11.357485+0000","last_clean":"2022-05-02T09:39:11.357485+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:11.357485+0000","last_undegraded":"2022-05-02T09:39:11.357485+0000","last_fullsized":"2022-05-02T09:39:11.357485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.344885+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:14.344885+0000","last_peered":"2022-05-02T09:39:14.344885+0000","last_clean":"2022-05-02T09:39:14.344885+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:14.344885+0000","last_undegraded":"2022-05-02T09:39:14.344885+0000","last_fullsized":"2022-05-02T09:39:14.344885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374217+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:11.374217+0000","last_peered":"2022-05-02T09:39:11.374217+0000","last_clean":"2022-05-02T09:39:11.374217+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:11.374217+0000","last_undegraded":"2022-05-02T09:39:11.374217+0000","last_fullsized":"2022-05-02T09:39:11.374217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368927+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:11.368927+0000","last_peered":"2022-05-02T09:39:11.368927+0000","last_clean":"2022-05-02T09:39:11.368927+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:11.368927+0000","last_undegraded":"2022-05-02T09:39:11.368927+0000","last_fullsized":"2022-05-02T09:39:11.368927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.373265+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:11.373265+0000","last_peered":"2022-05-02T09:39:11.373265+0000","last_clean":"2022-05-02T09:39:11.373265+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:11.373265+0000","last_undegraded":"2022-05-02T09:39:11.373265+0000","last_fullsized":"2022-05-02T09:39:11.373265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.348885+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:11.348885+0000","last_peered":"2022-05-02T09:39:11.348885+0000","last_clean":"2022-05-02T09:39:11.348885+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:11.348885+0000","last_undegraded":"2022-05-02T09:39:11.348885+0000","last_fullsized":"2022-05-02T09:39:11.348885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360401+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:11.360401+0000","last_peered":"2022-05-02T09:39:11.360401+0000","last_clean":"2022-05-02T09:39:11.360401+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:11.360401+0000","last_undegraded":"2022-05-02T09:39:11.360401+0000","last_fullsized":"2022-05-02T09:39:11.360401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.372713+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:11.372713+0000","last_peered":"2022-05-02T09:39:11.372713+0000","last_clean":"2022-05-02T09:39:11.372713+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:11.372713+0000","last_undegraded":"2022-05-02T09:39:11.372713+0000","last_fullsized":"2022-05-02T09:39:11.372713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357412+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:11.357412+0000","last_peered":"2022-05-02T09:39:11.357412+0000","last_clean":"2022-05-02T09:39:11.357412+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:11.357412+0000","last_undegraded":"2022-05-02T09:39:11.357412+0000","last_fullsized":"2022-05-02T09:39:11.357412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.325992+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:11.325992+0000","last_peered":"2022-05-02T09:39:11.325992+0000","last_clean":"2022-05-02T09:39:11.325992+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:11.325992+0000","last_undegraded":"2022-05-02T09:39:11.325992+0000","last_fullsized":"2022-05-02T09:39:11.325992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365391+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:11.365391+0000","last_peered":"2022-05-02T09:39:11.365391+0000","last_clean":"2022-05-02T09:39:11.365391+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:11.365391+0000","last_undegraded":"2022-05-02T09:39:11.365391+0000","last_fullsized":"2022-05-02T09:39:11.365391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346299+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:14.346299+0000","last_peered":"2022-05-02T09:39:14.346299+0000","last_clean":"2022-05-02T09:39:14.346299+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:14.346299+0000","last_undegraded":"2022-05-02T09:39:14.346299+0000","last_fullsized":"2022-05-02T09:39:14.346299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347440+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:11.347440+0000","last_peered":"2022-05-02T09:39:11.347440+0000","last_clean":"2022-05-02T09:39:11.347440+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:11.347440+0000","last_undegraded":"2022-05-02T09:39:11.347440+0000","last_fullsized":"2022-05-02T09:39:11.347440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:13.175949+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:13.175949+0000","last_peered":"2022-05-02T09:39:13.175949+0000","last_clean":"2022-05-02T09:39:13.175949+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:13.175949+0000","last_undegraded":"2022-05-02T09:39:13.175949+0000","last_fullsized":"2022-05-02T09:39:13.175949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374357+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:11.374357+0000","last_peered":"2022-05-02T09:39:11.374357+0000","last_clean":"2022-05-02T09:39:11.374357+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:11.374357+0000","last_undegraded":"2022-05-02T09:39:11.374357+0000","last_fullsized":"2022-05-02T09:39:11.374357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.347002+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:14.347002+0000","last_peered":"2022-05-02T09:39:14.347002+0000","last_clean":"2022-05-02T09:39:14.347002+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:14.347002+0000","last_undegraded":"2022-05-02T09:39:14.347002+0000","last_fullsized":"2022-05-02T09:39:14.347002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357166+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:11.357166+0000","last_peered":"2022-05-02T09:39:11.357166+0000","last_clean":"2022-05-02T09:39:11.357166+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:11.357166+0000","last_undegraded":"2022-05-02T09:39:11.357166+0000","last_fullsized":"2022-05-02T09:39:11.357166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346745+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:14.346745+0000","last_peered":"2022-05-02T09:39:14.346745+0000","last_clean":"2022-05-02T09:39:14.346745+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:14.346745+0000","last_undegraded":"2022-05-02T09:39:14.346745+0000","last_fullsized":"2022-05-02T09:39:14.346745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361382+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:11.361382+0000","last_peered":"2022-05-02T09:39:11.361382+0000","last_clean":"2022-05-02T09:39:11.361382+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:11.361382+0000","last_undegraded":"2022-05-02T09:39:11.361382+0000","last_fullsized":"2022-05-02T09:39:11.361382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.321742+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:11.321742+0000","last_peered":"2022-05-02T09:39:11.321742+0000","last_clean":"2022-05-02T09:39:11.321742+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:11.321742+0000","last_undegraded":"2022-05-02T09:39:11.321742+0000","last_fullsized":"2022-05-02T09:39:11.321742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.309990+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:12.309990+0000","last_peered":"2022-05-02T09:39:12.309990+0000","last_clean":"2022-05-02T09:39:12.309990+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:12.309990+0000","last_undegraded":"2022-05-02T09:39:12.309990+0000","last_fullsized":"2022-05-02T09:39:12.309990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.366309+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:11.366309+0000","last_peered":"2022-05-02T09:39:11.366309+0000","last_clean":"2022-05-02T09:39:11.366309+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:11.366309+0000","last_undegraded":"2022-05-02T09:39:11.366309+0000","last_fullsized":"2022-05-02T09:39:11.366309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313812+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:11.313812+0000","last_peered":"2022-05-02T09:39:11.313812+0000","last_clean":"2022-05-02T09:39:11.313812+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:11.313812+0000","last_undegraded":"2022-05-02T09:39:11.313812+0000","last_fullsized":"2022-05-02T09:39:11.313812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346586+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:14.346586+0000","last_peered":"2022-05-02T09:39:14.346586+0000","last_clean":"2022-05-02T09:39:14.346586+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:14.346586+0000","last_undegraded":"2022-05-02T09:39:14.346586+0000","last_fullsized":"2022-05-02T09:39:14.346586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361284+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:11.361284+0000","last_peered":"2022-05-02T09:39:11.361284+0000","last_clean":"2022-05-02T09:39:11.361284+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:11.361284+0000","last_undegraded":"2022-05-02T09:39:11.361284+0000","last_fullsized":"2022-05-02T09:39:11.361284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.316222+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:11.316222+0000","last_peered":"2022-05-02T09:39:11.316222+0000","last_clean":"2022-05-02T09:39:11.316222+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:11.316222+0000","last_undegraded":"2022-05-02T09:39:11.316222+0000","last_fullsized":"2022-05-02T09:39:11.316222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.737867+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:12.737867+0000","last_peered":"2022-05-02T09:39:12.737867+0000","last_clean":"2022-05-02T09:39:12.737867+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:12.737867+0000","last_undegraded":"2022-05-02T09:39:12.737867+0000","last_fullsized":"2022-05-02T09:39:12.737867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367748+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:11.367748+0000","last_peered":"2022-05-02T09:39:11.367748+0000","last_clean":"2022-05-02T09:39:11.367748+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:11.367748+0000","last_undegraded":"2022-05-02T09:39:11.367748+0000","last_fullsized":"2022-05-02T09:39:11.367748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313763+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:11.313763+0000","last_peered":"2022-05-02T09:39:11.313763+0000","last_clean":"2022-05-02T09:39:11.313763+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:11.313763+0000","last_undegraded":"2022-05-02T09:39:11.313763+0000","last_fullsized":"2022-05-02T09:39:11.313763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312314+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:11.312314+0000","last_peered":"2022-05-02T09:39:11.312314+0000","last_clean":"2022-05-02T09:39:11.312314+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:11.312314+0000","last_undegraded":"2022-05-02T09:39:11.312314+0000","last_fullsized":"2022-05-02T09:39:11.312314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.313542+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:11.313542+0000","last_peered":"2022-05-02T09:39:11.313542+0000","last_clean":"2022-05-02T09:39:11.313542+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:11.313542+0000","last_undegraded":"2022-05-02T09:39:11.313542+0000","last_fullsized":"2022-05-02T09:39:11.313542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374380+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:11.374380+0000","last_peered":"2022-05-02T09:39:11.374380+0000","last_clean":"2022-05-02T09:39:11.374380+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:11.374380+0000","last_undegraded":"2022-05-02T09:39:11.374380+0000","last_fullsized":"2022-05-02T09:39:11.374380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.312941+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:11.312941+0000","last_peered":"2022-05-02T09:39:11.312941+0000","last_clean":"2022-05-02T09:39:11.312941+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:11.312941+0000","last_undegraded":"2022-05-02T09:39:11.312941+0000","last_fullsized":"2022-05-02T09:39:11.312941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.311122+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:12.311122+0000","last_peered":"2022-05-02T09:39:12.311122+0000","last_clean":"2022-05-02T09:39:12.311122+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:12.311122+0000","last_undegraded":"2022-05-02T09:39:12.311122+0000","last_fullsized":"2022-05-02T09:39:12.311122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365451+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:11.365451+0000","last_peered":"2022-05-02T09:39:11.365451+0000","last_clean":"2022-05-02T09:39:11.365451+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:11.365451+0000","last_undegraded":"2022-05-02T09:39:11.365451+0000","last_fullsized":"2022-05-02T09:39:11.365451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.319431+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:11.319431+0000","last_peered":"2022-05-02T09:39:11.319431+0000","last_clean":"2022-05-02T09:39:11.319431+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:11.319431+0000","last_undegraded":"2022-05-02T09:39:11.319431+0000","last_fullsized":"2022-05-02T09:39:11.319431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.317299+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:11.317299+0000","last_peered":"2022-05-02T09:39:11.317299+0000","last_clean":"2022-05-02T09:39:11.317299+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:11.317299+0000","last_undegraded":"2022-05-02T09:39:11.317299+0000","last_fullsized":"2022-05-02T09:39:11.317299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.365371+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:11.365371+0000","last_peered":"2022-05-02T09:39:11.365371+0000","last_clean":"2022-05-02T09:39:11.365371+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:11.365371+0000","last_undegraded":"2022-05-02T09:39:11.365371+0000","last_fullsized":"2022-05-02T09:39:11.365371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.346024+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:14.346024+0000","last_peered":"2022-05-02T09:39:14.346024+0000","last_clean":"2022-05-02T09:39:14.346024+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:14.346024+0000","last_undegraded":"2022-05-02T09:39:14.346024+0000","last_fullsized":"2022-05-02T09:39:14.346024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.320945+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:11.320945+0000","last_peered":"2022-05-02T09:39:11.320945+0000","last_clean":"2022-05-02T09:39:11.320945+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:11.320945+0000","last_undegraded":"2022-05-02T09:39:11.320945+0000","last_fullsized":"2022-05-02T09:39:11.320945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374239+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:11.374239+0000","last_peered":"2022-05-02T09:39:11.374239+0000","last_clean":"2022-05-02T09:39:11.374239+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:11.374239+0000","last_undegraded":"2022-05-02T09:39:11.374239+0000","last_fullsized":"2022-05-02T09:39:11.374239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.314878+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:11.314878+0000","last_peered":"2022-05-02T09:39:11.314878+0000","last_clean":"2022-05-02T09:39:11.314878+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:11.314878+0000","last_undegraded":"2022-05-02T09:39:11.314878+0000","last_fullsized":"2022-05-02T09:39:11.314878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:12.312697+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:12.312697+0000","last_peered":"2022-05-02T09:39:12.312697+0000","last_clean":"2022-05-02T09:39:12.312697+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:12.312697+0000","last_undegraded":"2022-05-02T09:39:12.312697+0000","last_fullsized":"2022-05-02T09:39:12.312697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.345426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:11.345426+0000","last_peered":"2022-05-02T09:39:11.345426+0000","last_clean":"2022-05-02T09:39:11.345426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:11.345426+0000","last_undegraded":"2022-05-02T09:39:11.345426+0000","last_fullsized":"2022-05-02T09:39:11.345426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-05-02T09:39:14.349020+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:14.349020+0000","last_peered":"2022-05-02T09:39:14.349020+0000","last_clean":"2022-05-02T09:39:14.349020+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:14.349020+0000","last_undegraded":"2022-05-02T09:39:14.349020+0000","last_fullsized":"2022-05-02T09:39:14.349020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367944+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:11.367944+0000","last_peered":"2022-05-02T09:39:11.367944+0000","last_clean":"2022-05-02T09:39:11.367944+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:11.367944+0000","last_undegraded":"2022-05-02T09:39:11.367944+0000","last_fullsized":"2022-05-02T09:39:11.367944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.361211+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:11.361211+0000","last_peered":"2022-05-02T09:39:11.361211+0000","last_clean":"2022-05-02T09:39:11.361211+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:11.361211+0000","last_undegraded":"2022-05-02T09:39:11.361211+0000","last_fullsized":"2022-05-02T09:39:11.361211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.355195+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:11.355195+0000","last_peered":"2022-05-02T09:39:11.355195+0000","last_clean":"2022-05-02T09:39:11.355195+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:11.355195+0000","last_undegraded":"2022-05-02T09:39:11.355195+0000","last_fullsized":"2022-05-02T09:39:11.355195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.354864+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:11.354864+0000","last_peered":"2022-05-02T09:39:11.354864+0000","last_clean":"2022-05-02T09:39:11.354864+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:11.354864+0000","last_undegraded":"2022-05-02T09:39:11.354864+0000","last_fullsized":"2022-05-02T09:39:11.354864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.357437+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:11.357437+0000","last_peered":"2022-05-02T09:39:11.357437+0000","last_clean":"2022-05-02T09:39:11.357437+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:11.357437+0000","last_undegraded":"2022-05-02T09:39:11.357437+0000","last_fullsized":"2022-05-02T09:39:11.357437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347169+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:11.347169+0000","last_peered":"2022-05-02T09:39:11.347169+0000","last_clean":"2022-05-02T09:39:11.347169+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:11.347169+0000","last_undegraded":"2022-05-02T09:39:11.347169+0000","last_fullsized":"2022-05-02T09:39:11.347169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.336363+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:11.336363+0000","last_peered":"2022-05-02T09:39:11.336363+0000","last_clean":"2022-05-02T09:39:11.336363+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:11.336363+0000","last_undegraded":"2022-05-02T09:39:11.336363+0000","last_fullsized":"2022-05-02T09:39:11.336363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.369133+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:11.369133+0000","last_peered":"2022-05-02T09:39:11.369133+0000","last_clean":"2022-05-02T09:39:11.369133+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:11.369133+0000","last_undegraded":"2022-05-02T09:39:11.369133+0000","last_fullsized":"2022-05-02T09:39:11.369133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.367896+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:11.367896+0000","last_peered":"2022-05-02T09:39:11.367896+0000","last_clean":"2022-05-02T09:39:11.367896+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:11.367896+0000","last_undegraded":"2022-05-02T09:39:11.367896+0000","last_fullsized":"2022-05-02T09:39:11.367896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.360368+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:11.360368+0000","last_peered":"2022-05-02T09:39:11.360368+0000","last_clean":"2022-05-02T09:39:11.360368+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:11.360368+0000","last_undegraded":"2022-05-02T09:39:11.360368+0000","last_fullsized":"2022-05-02T09:39:11.360368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.346985+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:11.346985+0000","last_peered":"2022-05-02T09:39:11.346985+0000","last_clean":"2022-05-02T09:39:11.346985+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:11.346985+0000","last_undegraded":"2022-05-02T09:39:11.346985+0000","last_fullsized":"2022-05-02T09:39:11.346985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.347483+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:11.347483+0000","last_peered":"2022-05-02T09:39:11.347483+0000","last_clean":"2022-05-02T09:39:11.347483+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:11.347483+0000","last_undegraded":"2022-05-02T09:39:11.347483+0000","last_fullsized":"2022-05-02T09:39:11.347483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.374132+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:11.374132+0000","last_peered":"2022-05-02T09:39:11.374132+0000","last_clean":"2022-05-02T09:39:11.374132+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:11.374132+0000","last_undegraded":"2022-05-02T09:39:11.374132+0000","last_fullsized":"2022-05-02T09:39:11.374132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-05-02T09:39:11.368847+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:11.368847+0000","last_peered":"2022-05-02T09:39:11.368847+0000","last_clean":"2022-05-02T09:39:11.368847+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:11.368847+0000","last_undegraded":"2022-05-02T09:39:11.368847+0000","last_fullsized":"2022-05-02T09:39:11.368847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":56079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]}]}} 2022-05-02T09:39:22.801 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-05-02T09:39:22.801 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-05-02T09:39:22.801 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-05-02T09:39:22.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-05-02T09:39:23.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.003+0000 7fbed4f9d700 1 Processor -- start 2022-05-02T09:39:23.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.003+0000 7fbed4f9d700 1 -- start start 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbed4f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbed0139720 0x7fbed005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbed4f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139b00 0x7fbed005d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbed4f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed0139010 con 0x7fbed005cc50 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbed4f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed01392d0 con 0x7fbed0139720 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbed4f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00a7c50 con 0x7fbed0139b00 2022-05-02T09:39:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.004+0000 7fbecf7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbed0139720 0x7fbed005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbed005cc50 0x7fbed005fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52196/0 (socket says 172.21.15.50:52196) 2022-05-02T09:39:23.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecffff700 1 -- 172.21.15.50:0/1125778837 learned_addr learned my addr 172.21.15.50:0/1125778837 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:23.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbeceffd700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139b00 0x7fbed005d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecf7fe700 1 -- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139b00 msgr2=0x7fbed005d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:23.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecf7fe700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139b00 0x7fbed005d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecf7fe700 1 -- 172.21.15.50:0/1125778837 >> v1:172.21.15.50:6789/0 conn(0x7fbed005cc50 legacy=0x7fbed005fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecf7fe700 1 -- 172.21.15.50:0/1125778837 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00a95d0 con 0x7fbed0139720 2022-05-02T09:39:23.010 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.005+0000 7fbecf7fe700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed0139720 0x7fbed005b8a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbec0002f70 tx=0x7fbec0006df0).ready entity=mon.0 client_cookie=823dc4fec1ab7e34 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbece7fc700 1 -- 172.21.15.50:0/1125778837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec000d570 con 0x7fbed0139720 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbece7fc700 1 -- 172.21.15.50:0/1125778837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0000e90 con 0x7fbed0139720 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbece7fc700 1 -- 172.21.15.50:0/1125778837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec000d8c0 con 0x7fbed0139720 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 -- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed0139720 msgr2=0x7fbed005b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed0139720 0x7fbed005b8a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbec0002f70 tx=0x7fbec0006df0).stop 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 -- 172.21.15.50:0/1125778837 shutdown_connections 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed0139720 0x7fbed005b8a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/1125778837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139b00 0x7fbed005d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 -- 172.21.15.50:0/1125778837 >> 172.21.15.50:0/1125778837 conn(0x7fbed00669d0 msgr2=0x7fbed00a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 -- 172.21.15.50:0/1125778837 shutdown_connections 2022-05-02T09:39:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.006+0000 7fbed4f9d700 1 -- 172.21.15.50:0/1125778837 wait complete. 2022-05-02T09:39:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.007+0000 7fbed4f9d700 1 Processor -- start 2022-05-02T09:39:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.008+0000 7fbed4f9d700 1 -- start start 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.008+0000 7fbed4f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.008+0000 7fbed4f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 0x7fbed0145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbed4f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbed0139b00 0x7fbed00a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbed4f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0146360 con 0x7fbed005cc50 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbed4f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01460b0 con 0x7fbed0139720 2022-05-02T09:39:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbed4f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0146600 con 0x7fbed0139b00 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 0x7fbed0145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35726/0 (socket says 172.21.15.50:35726) 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 -- 172.21.15.50:0/2782454989 learned_addr learned my addr 172.21.15.50:0/2782454989 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecffff700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbed0139b00 0x7fbed00a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 -- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbed0139b00 msgr2=0x7fbed00a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbed0139b00 0x7fbed00a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 -- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 msgr2=0x7fbed0145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 0x7fbed0145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbecf7fe700 1 -- 172.21.15.50:0/2782454989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec000b180 con 0x7fbed005cc50 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.009+0000 7fbeceffd700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 0x7fbed0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbecf7fe700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fbec0002f70 tx=0x7fbec0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec0013de0 con 0x7fbed005cc50 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec001e400 con 0x7fbed005cc50 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec001e760 con 0x7fbed005cc50 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed00a21c0 con 0x7fbed005cc50 2022-05-02T09:39:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.010+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00a2e90 con 0x7fbed005cc50 2022-05-02T09:39:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.011+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00a17f0 con 0x7fbed005cc50 2022-05-02T09:39:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.012+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fbec0025030 con 0x7fbed005cc50 2022-05-02T09:39:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.012+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbec004b180 con 0x7fbed005cc50 2022-05-02T09:39:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.015+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbec001f850 con 0x7fbed005cc50 2022-05-02T09:39:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.178+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbed00a0880 con 0x7fbed005cc50 2022-05-02T09:39:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.179+0000 7fbeccff9700 1 -- 172.21.15.50:0/2782454989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fbec0023030 con 0x7fbed005cc50 2022-05-02T09:39:23.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:23.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.180+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 >> v1:172.21.15.50:6800/30011 conn(0x7fbeb0038a60 legacy=0x7fbeb003af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.180+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 msgr2=0x7fbed00a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.180+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fbec0002f70 tx=0x7fbec0014000).stop 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 shutdown_connections 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbed0139b00 0x7fbed00a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbed005cc50 0x7fbed00a1ba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 --2- 172.21.15.50:0/2782454989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbed0139720 0x7fbed0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 >> 172.21.15.50:0/2782454989 conn(0x7fbed00669d0 msgr2=0x7fbed00ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 shutdown_connections 2022-05-02T09:39:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.181+0000 7fbed4f9d700 1 -- 172.21.15.50:0/2782454989 wait complete. 2022-05-02T09:39:23.206 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-05-02T09:39:23.207 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-05-02T09:39:23.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:23.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.411+0000 7f774299d700 1 Processor -- start 2022-05-02T09:39:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.411+0000 7f774299d700 1 -- start start 2022-05-02T09:39:23.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c139720 0x7f773c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c05cc50 0x7f773c05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c139010 con 0x7f773c139720 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c1392d0 con 0x7f773c139b00 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.412+0000 7f774299d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a7c50 con 0x7f773c05cc50 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c139720 0x7f773c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774119a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c139720 0x7f773c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35728/0 (socket says 172.21.15.50:35728) 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 -- 172.21.15.50:0/1570680941 learned_addr learned my addr 172.21.15.50:0/1570680941 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:23.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774119a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50304/0 (socket says 172.21.15.50:50304) 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774219c700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c05cc50 0x7f773c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 -- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c05cc50 msgr2=0x7f773c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c05cc50 0x7f773c05fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 -- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 msgr2=0x7f773c05d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774199b700 1 -- 172.21.15.50:0/1570680941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0a95d0 con 0x7f773c139720 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.413+0000 7f774119a700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f774199b700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c05b8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7738002f70 tx=0x7f7738006eb0).ready entity=mon.0 client_cookie=4e4cdea47827dff7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f7740999700 1 -- 172.21.15.50:0/1570680941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f773800d570 con 0x7f773c139720 2022-05-02T09:39:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f7740999700 1 -- 172.21.15.50:0/1570680941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738000e90 con 0x7f773c139720 2022-05-02T09:39:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f7740999700 1 -- 172.21.15.50:0/1570680941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f773800d900 con 0x7f773c139720 2022-05-02T09:39:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f774299d700 1 -- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 msgr2=0x7f773c05b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.414+0000 7f774299d700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c05b8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7738002f70 tx=0x7f7738006eb0).stop 2022-05-02T09:39:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 -- 172.21.15.50:0/1570680941 shutdown_connections 2022-05-02T09:39:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c05cc50 0x7f773c05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c05b8a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 --2- 172.21.15.50:0/1570680941 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c139b00 0x7f773c05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 -- 172.21.15.50:0/1570680941 >> 172.21.15.50:0/1570680941 conn(0x7f773c0669d0 msgr2=0x7f773c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 -- 172.21.15.50:0/1570680941 shutdown_connections 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.415+0000 7f774299d700 1 -- 172.21.15.50:0/1570680941 wait complete. 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.416+0000 7f774299d700 1 Processor -- start 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.416+0000 7f774299d700 1 -- start start 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 0x7f773c0a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c139b00 0x7f773c148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a1920 con 0x7f773c139720 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a16b0 con 0x7f773c05cc50 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774299d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c1325e0 con 0x7f773c139b00 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774119a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774199b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 0x7f773c0a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774119a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35730/0 (socket says 172.21.15.50:35730) 2022-05-02T09:39:23.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774119a700 1 -- 172.21.15.50:0/1279713282 learned_addr learned my addr 172.21.15.50:0/1279713282 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:23.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.417+0000 7f774219c700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c139b00 0x7f773c148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.425 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 -- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c139b00 msgr2=0x7f773c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c139b00 0x7f773c148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 -- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 msgr2=0x7f773c0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 0x7f773c0a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 -- 172.21.15.50:0/1279713282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c00b180 con 0x7f773c139720 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774199b700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 0x7f773c0a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774119a700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f772c00c000 tx=0x7f772c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772c010780 con 0x7f773c139720 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0108e0 con 0x7f773c139720 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773800b1e0 con 0x7f773c139720 2022-05-02T09:39:23.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.418+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772c010c40 con 0x7f773c139720 2022-05-02T09:39:23.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.419+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c130170 con 0x7f773c139720 2022-05-02T09:39:23.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.420+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c05d0e0 con 0x7f773c139720 2022-05-02T09:39:23.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.420+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f772c01c460 con 0x7f773c139720 2022-05-02T09:39:23.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.420+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f772c04a900 con 0x7f773c139720 2022-05-02T09:39:23.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.424+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f772c033360 con 0x7f773c139720 2022-05-02T09:39:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.548+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f773c132790 con 0x7f773c139720 2022-05-02T09:39:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.549+0000 7f772affd700 1 -- 172.21.15.50:0/1279713282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f772c032f50 con 0x7f773c139720 2022-05-02T09:39:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:23.552 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:12.304403+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.551+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 >> v1:172.21.15.50:6800/30011 conn(0x7f771c038940 legacy=0x7f771c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.551+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 msgr2=0x7f773c148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.551+0000 7f774299d700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f772c00c000 tx=0x7f772c006df0).stop 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 shutdown_connections 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f773c139b00 0x7f773c148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f773c05cc50 0x7f773c0a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 --2- 172.21.15.50:0/1279713282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c139720 0x7f773c148710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 >> 172.21.15.50:0/1279713282 conn(0x7f773c0669d0 msgr2=0x7f773c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 shutdown_connections 2022-05-02T09:39:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.552+0000 7f774299d700 1 -- 172.21.15.50:0/1279713282 wait complete. 2022-05-02T09:39:23.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-05-02T09:39:08.938842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-05-02T09:39:10.323546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-05-02T09:39:23.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-05-02T09:39:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.784+0000 7f1deed9d700 1 Processor -- start 2022-05-02T09:39:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.785+0000 7f1deed9d700 1 -- start start 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1deed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139720 0x7f1de805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1deed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1de805d7d0 0x7f1de81402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1deed9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de805d360 con 0x7f1de8139b00 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1deed9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de8139010 con 0x7f1de805d7d0 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1deed9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81392d0 con 0x7f1de8139720 2022-05-02T09:39:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1dee59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1de805d7d0 0x7f1de81402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1dedd9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139720 0x7f1de805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1ded59a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1de8139b00 0x7f1de805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52198/0 (socket says 172.21.15.50:52198) 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.786+0000 7f1ded59a700 1 -- 172.21.15.50:0/3097460449 learned_addr learned my addr 172.21.15.50:0/3097460449 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1dee59c700 1 -- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139720 msgr2=0x7f1de805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1dee59c700 1 --2- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139720 0x7f1de805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1dee59c700 1 -- 172.21.15.50:0/3097460449 >> v1:172.21.15.50:6789/0 conn(0x7f1de8139b00 legacy=0x7f1de805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1dee59c700 1 -- 172.21.15.50:0/3097460449 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80a7c50 con 0x7f1de805d7d0 2022-05-02T09:39:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1dee59c700 1 --2- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de81402a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1de00032f0 tx=0x7f1de00091d0).ready entity=mon.0 client_cookie=a7b08b94d0780f9f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1decd99700 1 -- 172.21.15.50:0/3097460449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de000b6c0 con 0x7f1de805d7d0 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1decd99700 1 -- 172.21.15.50:0/3097460449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000b820 con 0x7f1de805d7d0 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.787+0000 7f1decd99700 1 -- 172.21.15.50:0/3097460449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de000b990 con 0x7f1de805d7d0 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 -- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 msgr2=0x7f1de81402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 --2- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de81402a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1de00032f0 tx=0x7f1de00091d0).stop 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 -- 172.21.15.50:0/3097460449 shutdown_connections 2022-05-02T09:39:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 --2- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de81402a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 --2- 172.21.15.50:0/3097460449 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139720 0x7f1de805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 -- 172.21.15.50:0/3097460449 >> 172.21.15.50:0/3097460449 conn(0x7f1de80669d0 msgr2=0x7f1de80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 -- 172.21.15.50:0/3097460449 shutdown_connections 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.788+0000 7f1deed9d700 1 -- 172.21.15.50:0/3097460449 wait complete. 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.789+0000 7f1deed9d700 1 Processor -- start 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.789+0000 7f1deed9d700 1 -- start start 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1de8139720 0x7f1de8148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139b00 0x7f1de8148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80a1490 con 0x7f1de805d7d0 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80a0630 con 0x7f1de8139720 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1deed9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80a1960 con 0x7f1de8139b00 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1dedd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1ded59a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1de8139720 0x7f1de8148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1dedd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35734/0 (socket says 172.21.15.50:35734) 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.790+0000 7f1dedd9b700 1 -- 172.21.15.50:0/1043147530 learned_addr learned my addr 172.21.15.50:0/1043147530 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dee59c700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139b00 0x7f1de8148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 -- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139b00 msgr2=0x7f1de8148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139b00 0x7f1de8148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 -- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1de8139720 msgr2=0x7f1de8148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1de8139720 0x7f1de8148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 -- 172.21.15.50:0/1043147530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009470 con 0x7f1de805d7d0 2022-05-02T09:39:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dedd9b700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1de400c000 tx=0x7f1de4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de4011750 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de40118b0 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.791+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de4011c10 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.792+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de80a63d0 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.792+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de8132b30 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.793+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f1de4011d70 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.793+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8057990 con 0x7f1de805d7d0 2022-05-02T09:39:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.793+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1de404a780 con 0x7f1de805d7d0 2022-05-02T09:39:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.796+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1de40331e0 con 0x7f1de805d7d0 2022-05-02T09:39:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.921+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1de8061b40 con 0x7f1de805d7d0 2022-05-02T09:39:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.922+0000 7f1dd6ffd700 1 -- 172.21.15.50:0/1043147530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1de4032dd0 con 0x7f1de805d7d0 2022-05-02T09:39:23.925 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:39:23.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.923+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 >> v1:172.21.15.50:6800/30011 conn(0x7f1dc8038a90 legacy=0x7f1dc803af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.923+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 msgr2=0x7f1de80a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:23.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.923+0000 7f1deed9d700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1de400c000 tx=0x7f1de4006df0).stop 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 shutdown_connections 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1de8139b00 0x7f1de8148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1de805d7d0 0x7f1de80a0ac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 --2- 172.21.15.50:0/1043147530 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1de8139720 0x7f1de8148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 >> 172.21.15.50:0/1043147530 conn(0x7f1de80669d0 msgr2=0x7f1de81337d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 shutdown_connections 2022-05-02T09:39:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:23.924+0000 7f1deed9d700 1 -- 172.21.15.50:0/1043147530 wait complete. 2022-05-02T09:39:23.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:39:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.156+0000 7f7944b9d700 1 Processor -- start 2022-05-02T09:39:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.156+0000 7f7944b9d700 1 -- start start 2022-05-02T09:39:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f7944b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f79401327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f7944b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f7944b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400a7270 con 0x7f7940136140 2022-05-02T09:39:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f7944b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940094760 con 0x7f79400a6e90 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f7944b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7940135ea0 con 0x7f7940095430 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f793f7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f79401327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f793ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7940136140 0x7f79401365d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52200/0 (socket says 172.21.15.50:52200) 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f793ffff700 1 -- 172.21.15.50:0/3719359003 learned_addr learned my addr 172.21.15.50:0/3719359003 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.157+0000 7f793effd700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793f7fe700 1 -- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 msgr2=0x7f79401330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793f7fe700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401330b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793f7fe700 1 -- 172.21.15.50:0/3719359003 >> v1:172.21.15.50:6789/0 conn(0x7f7940136140 legacy=0x7f79401365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793e7fc700 1 -- 172.21.15.50:0/3719359003 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887983680 0 0) 0x7f79400a7270 con 0x7f7940136140 2022-05-02T09:39:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793f7fe700 1 -- 172.21.15.50:0/3719359003 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79401335a0 con 0x7f79400a6e90 2022-05-02T09:39:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793f7fe700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f79401327d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7930002f70 tx=0x7f7930006df0).ready entity=mon.1 client_cookie=87ba79e2a84879bd server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793e7fc700 1 -- 172.21.15.50:0/3719359003 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f793000d570 con 0x7f79400a6e90 2022-05-02T09:39:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793e7fc700 1 -- 172.21.15.50:0/3719359003 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930000e90 con 0x7f79400a6e90 2022-05-02T09:39:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.158+0000 7f793e7fc700 1 -- 172.21.15.50:0/3719359003 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f793000d8c0 con 0x7f79400a6e90 2022-05-02T09:39:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 -- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 msgr2=0x7f79401327d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f79401327d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7930002f70 tx=0x7f7930006df0).stop 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 -- 172.21.15.50:0/3719359003 shutdown_connections 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f79401327d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 --2- 172.21.15.50:0/3719359003 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 -- 172.21.15.50:0/3719359003 >> 172.21.15.50:0/3719359003 conn(0x7f794005b8a0 msgr2=0x7f794005bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 -- 172.21.15.50:0/3719359003 shutdown_connections 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.159+0000 7f7944b9d700 1 -- 172.21.15.50:0/3719359003 wait complete. 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.160+0000 7f7944b9d700 1 Processor -- start 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.160+0000 7f7944b9d700 1 -- start start 2022-05-02T09:39:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401310c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7940136140 0x7f7940148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940133eb0 con 0x7f7940136140 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940131a90 con 0x7f79400a6e90 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.161+0000 7f7944b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f794012d8f0 con 0x7f7940095430 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50312/0 (socket says 172.21.15.50:50312) 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 -- 172.21.15.50:0/1141549267 learned_addr learned my addr 172.21.15.50:0/1141549267 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793ffff700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7940136140 0x7f7940148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793f7fe700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 -- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 msgr2=0x7f79401310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 -- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7940136140 msgr2=0x7f7940148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7940136140 0x7f7940148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 -- 172.21.15.50:0/1141549267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793000b180 con 0x7f79400a6e90 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.162+0000 7f793effd700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f793400c000 tx=0x7f7934006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.163+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7934010780 con 0x7f79400a6e90 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.163+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340108e0 con 0x7f79400a6e90 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.163+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7934010c40 con 0x7f79400a6e90 2022-05-02T09:39:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.163+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7940130b50 con 0x7f79400a6e90 2022-05-02T09:39:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.163+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7940132350 con 0x7f79400a6e90 2022-05-02T09:39:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.164+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794006c070 con 0x7f79400a6e90 2022-05-02T09:39:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.164+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f793401c460 con 0x7f79400a6e90 2022-05-02T09:39:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.165+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f793404a860 con 0x7f79400a6e90 2022-05-02T09:39:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.168+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7934033240 con 0x7f79400a6e90 2022-05-02T09:39:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.291+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7940057990 con 0x7f79400a6e90 2022-05-02T09:39:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.292+0000 7f793cff9700 1 -- 172.21.15.50:0/1141549267 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7934032e30 con 0x7f79400a6e90 2022-05-02T09:39:24.295 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:39:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.293+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 >> v1:172.21.15.50:6800/30011 conn(0x7f7920038940 legacy=0x7f792003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.293+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 msgr2=0x7f7940148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.293+0000 7f7944b9d700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f793400c000 tx=0x7f7934006df0).stop 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 shutdown_connections 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7940095430 0x7f79401310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7940136140 0x7f7940148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 --2- 172.21.15.50:0/1141549267 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79400a6e90 0x7f7940148720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 >> 172.21.15.50:0/1141549267 conn(0x7f794005b8a0 msgr2=0x7f79400a7560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 shutdown_connections 2022-05-02T09:39:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.294+0000 7f7944b9d700 1 -- 172.21.15.50:0/1141549267 wait complete. 2022-05-02T09:39:24.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-05-02T09:39:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.526+0000 7f5852bff700 1 Processor -- start 2022-05-02T09:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.526+0000 7f5852bff700 1 -- start start 2022-05-02T09:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.527+0000 7f5852bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09c4e0 0x7f584c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.527+0000 7f5852bff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f584c09b8d0 0x7f584c1406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.527+0000 7f5852bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c09bd60 con 0x7f584c139a10 2022-05-02T09:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.527+0000 7f5852bff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c061e10 con 0x7f584c09b8d0 2022-05-02T09:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.527+0000 7f5852bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f584c09b0f0 con 0x7f584c09c4e0 2022-05-02T09:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f584c09b8d0 0x7f584c1406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f584bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09c4e0 0x7f584c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585099b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f584c139a10 0x7f584c061440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52202/0 (socket says 172.21.15.50:52202) 2022-05-02T09:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585099b700 1 -- 172.21.15.50:0/710185995 learned_addr learned my addr 172.21.15.50:0/710185995 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 -- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09c4e0 msgr2=0x7f584c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 --2- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09c4e0 0x7f584c139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 -- 172.21.15.50:0/710185995 >> v1:172.21.15.50:6789/0 conn(0x7f584c139a10 legacy=0x7f584c061440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 -- 172.21.15.50:0/710185995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c139480 con 0x7f584c09b8d0 2022-05-02T09:39:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.528+0000 7f585119c700 1 --2- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c09b8d0 0x7f584c1406a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f58440032f0 tx=0x7f58440091d0).ready entity=mon.0 client_cookie=b695e723fc9f04e2 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f584b7fe700 1 -- 172.21.15.50:0/710185995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584400b6c0 con 0x7f584c09b8d0 2022-05-02T09:39:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f584b7fe700 1 -- 172.21.15.50:0/710185995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400b820 con 0x7f584c09b8d0 2022-05-02T09:39:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f584b7fe700 1 -- 172.21.15.50:0/710185995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584400b990 con 0x7f584c09b8d0 2022-05-02T09:39:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 -- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c09b8d0 msgr2=0x7f584c1406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 --2- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c09b8d0 0x7f584c1406a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f58440032f0 tx=0x7f58440091d0).stop 2022-05-02T09:39:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 -- 172.21.15.50:0/710185995 shutdown_connections 2022-05-02T09:39:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 --2- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c09b8d0 0x7f584c1406a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 --2- 172.21.15.50:0/710185995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09c4e0 0x7f584c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 -- 172.21.15.50:0/710185995 >> 172.21.15.50:0/710185995 conn(0x7f584c0aa090 msgr2=0x7f584c0aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 -- 172.21.15.50:0/710185995 shutdown_connections 2022-05-02T09:39:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.529+0000 7f5852bff700 1 -- 172.21.15.50:0/710185995 wait complete. 2022-05-02T09:39:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.530+0000 7f5852bff700 1 Processor -- start 2022-05-02T09:39:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 -- start start 2022-05-02T09:39:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09b8d0 0x7f584c149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c149840 0x7f584c096170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c149ce0 con 0x7f584c149840 2022-05-02T09:39:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c149170 con 0x7f584c139a10 2022-05-02T09:39:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.531+0000 7f5852bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0999c0 con 0x7f584c09b8d0 2022-05-02T09:39:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f585099b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09b8d0 0x7f584c149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50314/0 (socket says 172.21.15.50:50314) 2022-05-02T09:39:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 -- 172.21.15.50:0/2799372272 learned_addr learned my addr 172.21.15.50:0/2799372272 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f585119c700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c149840 0x7f584c096170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 -- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09b8d0 msgr2=0x7f584c149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09b8d0 0x7f584c149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 -- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c149840 msgr2=0x7f584c096170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c149840 0x7f584c096170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.532+0000 7f584bfff700 1 -- 172.21.15.50:0/2799372272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009470 con 0x7f584c139a10 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f584bfff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f583800c000 tx=0x7f5838006d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58380104c0 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838010620 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c061310 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5838010980 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.533+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c094b00 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.534+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f583801a070 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.534+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c061b50 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.535+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f583804a160 con 0x7f584c139a10 2022-05-02T09:39:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.538+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f583802f2a0 con 0x7f584c139a10 2022-05-02T09:39:24.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.666+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f584c057990 con 0x7f584c139a10 2022-05-02T09:39:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.666+0000 7f5849ffb700 1 -- 172.21.15.50:0/2799372272 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58380328c0 con 0x7f584c139a10 2022-05-02T09:39:24.669 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2022-05-02T09:39:24.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 >> v1:172.21.15.50:6800/30011 conn(0x7f582c0389d0 legacy=0x7f582c03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 msgr2=0x7f584c095c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f583800c000 tx=0x7f5838006d90).stop 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 shutdown_connections 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f584c09b8d0 0x7f584c149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f584c149840 0x7f584c096170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 --2- 172.21.15.50:0/2799372272 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f584c139a10 0x7f584c095c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.668+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 >> 172.21.15.50:0/2799372272 conn(0x7f584c0aa090 msgr2=0x7f584c137c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.669+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 shutdown_connections 2022-05-02T09:39:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.669+0000 7f5852bff700 1 -- 172.21.15.50:0/2799372272 wait complete. 2022-05-02T09:39:24.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-05-02T09:39:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.901+0000 7f5b5cf9d700 1 Processor -- start 2022-05-02T09:39:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.902+0000 7f5b5cf9d700 1 -- start start 2022-05-02T09:39:24.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b5cf9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b58139720 0x7f5b5805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b5cf9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 0x7f5b5805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b5cf9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b58139010 con 0x7f5b5805cc50 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b5cf9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b581392d0 con 0x7f5b58139720 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b5cf9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580a7c50 con 0x7f5b58139b00 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b577fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b58139720 0x7f5b5805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b57fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b5805cc50 0x7f5b5805fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52204/0 (socket says 172.21.15.50:52204) 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b56ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 0x7f5b5805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.903+0000 7f5b57fff700 1 -- 172.21.15.50:0/89408443 learned_addr learned my addr 172.21.15.50:0/89408443 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b577fe700 1 -- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 msgr2=0x7f5b5805d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b577fe700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 0x7f5b5805d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b577fe700 1 -- 172.21.15.50:0/89408443 >> v1:172.21.15.50:6789/0 conn(0x7f5b5805cc50 legacy=0x7f5b5805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b567fc700 1 -- 172.21.15.50:0/89408443 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048005293 0 0) 0x7f5b58139010 con 0x7f5b5805cc50 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b577fe700 1 -- 172.21.15.50:0/89408443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580a95d0 con 0x7f5b58139720 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b56ffd700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 0x7f5b5805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b577fe700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b5805b8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5b48002f70 tx=0x7f5b48006df0).ready entity=mon.0 client_cookie=6e11c4c0e8d35bf0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b567fc700 1 -- 172.21.15.50:0/89408443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b4800d570 con 0x7f5b58139720 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b567fc700 1 -- 172.21.15.50:0/89408443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b48000e90 con 0x7f5b58139720 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.904+0000 7f5b567fc700 1 -- 172.21.15.50:0/89408443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b4800d8c0 con 0x7f5b58139720 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 msgr2=0x7f5b5805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b5805b8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5b48002f70 tx=0x7f5b48006df0).stop 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/89408443 shutdown_connections 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b5805b8a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/89408443 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b58139b00 0x7f5b5805d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/89408443 >> 172.21.15.50:0/89408443 conn(0x7f5b580669d0 msgr2=0x7f5b580a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/89408443 shutdown_connections 2022-05-02T09:39:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.905+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/89408443 wait complete. 2022-05-02T09:39:24.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.906+0000 7f5b5cf9d700 1 Processor -- start 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.906+0000 7f5b5cf9d700 1 -- start start 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b580a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 0x7f5b5812de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580a2ed0 con 0x7f5b58139720 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580a3190 con 0x7f5b5805cc50 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b5cf9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580a2350 con 0x7f5b58139b00 2022-05-02T09:39:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b56ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b580a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50318/0 (socket says 172.21.15.50:50318) 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b577fe700 1 -- 172.21.15.50:0/1865649225 learned_addr learned my addr 172.21.15.50:0/1865649225 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.907+0000 7f5b57fff700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 0x7f5b5812de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 -- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 msgr2=0x7f5b580a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 -- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 msgr2=0x7f5b580a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b580a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 -- 172.21.15.50:0/1865649225 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c00b180 con 0x7f5b58139b00 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b577fe700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.908+0000 7f5b57fff700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 0x7f5b5812de10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5b50001250 tx=0x7f5b50007d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.909+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b50005ba0 con 0x7f5b58139b00 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.909+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50005d00 con 0x7f5b58139b00 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.909+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b50004a90 con 0x7f5b58139b00 2022-05-02T09:39:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.909+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4800b180 con 0x7f5b58139b00 2022-05-02T09:39:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.909+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b581324b0 con 0x7f5b58139b00 2022-05-02T09:39:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.910+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b580a25d0 con 0x7f5b58139b00 2022-05-02T09:39:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.910+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f5b50004bf0 con 0x7f5b58139b00 2022-05-02T09:39:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.910+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5b50049d30 con 0x7f5b58139b00 2022-05-02T09:39:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:24.913+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5b580a25d0 con 0x7f5b58139b00 2022-05-02T09:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.038+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b580a25d0 con 0x7f5b58139b00 2022-05-02T09:39:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.038+0000 7f5b54ff9700 1 -- 172.21.15.50:0/1865649225 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b580a25d0 con 0x7f5b58139b00 2022-05-02T09:39:25.189 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 >> v1:172.21.15.50:6800/30011 conn(0x7f5b38038a60 legacy=0x7f5b3803af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 msgr2=0x7f5b5812de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 0x7f5b5812de10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5b50001250 tx=0x7f5b50007d00).stop 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 shutdown_connections 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5b58139b00 0x7f5b5812de10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b5805cc50 0x7f5b580a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 --2- 172.21.15.50:0/1865649225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58139720 0x7f5b580a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 >> 172.21.15.50:0/1865649225 conn(0x7f5b580669d0 msgr2=0x7f5b580ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 shutdown_connections 2022-05-02T09:39:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.040+0000 7f5b5cf9d700 1 -- 172.21.15.50:0/1865649225 wait complete. 2022-05-02T09:39:25.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.396+0000 7f75dd9ff700 1 Processor -- start 2022-05-02T09:39:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.396+0000 7f75dd9ff700 1 -- start start 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d81367e0 0x7f75d80a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75d8136bc0 0x7f75d81372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d8066a80 0x7f75d81377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80a4810 con 0x7f75d8136bc0 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80671b0 con 0x7f75d81367e0 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75dd9ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80a4570 con 0x7f75d8066a80 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75d67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75d8136bc0 0x7f75d81372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75d6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d81367e0 0x7f75d80a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75d67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75d8136bc0 0x7f75d81372c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35746/0 (socket says 172.21.15.50:35746) 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.397+0000 7f75d67fc700 1 -- 172.21.15.50:0/1888333415 learned_addr learned my addr 172.21.15.50:0/1888333415 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d77fe700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d8066a80 0x7f75d81377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 -- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d8066a80 msgr2=0x7f75d81377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d8066a80 0x7f75d81377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 -- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d81367e0 msgr2=0x7f75d80a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d81367e0 0x7f75d80a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 -- 172.21.15.50:0/1888333415 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80a42c0 con 0x7f75d8136bc0 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d67fc700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d81372c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f75cc002f70 tx=0x7f75cc006eb0).ready entity=mon.0 client_cookie=1e5074faef1ea24d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.398+0000 7f75d5ffb700 1 -- 172.21.15.50:0/1888333415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75cc00d570 con 0x7f75d8136bc0 2022-05-02T09:39:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75d5ffb700 1 -- 172.21.15.50:0/1888333415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc000e90 con 0x7f75d8136bc0 2022-05-02T09:39:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75d5ffb700 1 -- 172.21.15.50:0/1888333415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75cc00d8c0 con 0x7f75d8136bc0 2022-05-02T09:39:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 -- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 msgr2=0x7f75d81372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d81372c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f75cc002f70 tx=0x7f75cc006eb0).stop 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 -- 172.21.15.50:0/1888333415 shutdown_connections 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d8066a80 0x7f75d81377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d81367e0 0x7f75d80a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/1888333415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d81372c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 -- 172.21.15.50:0/1888333415 >> 172.21.15.50:0/1888333415 conn(0x7f75d80a8690 msgr2=0x7f75d80a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 -- 172.21.15.50:0/1888333415 shutdown_connections 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.399+0000 7f75dd9ff700 1 -- 172.21.15.50:0/1888333415 wait complete. 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.400+0000 7f75dd9ff700 1 Processor -- start 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.401+0000 7f75dd9ff700 1 -- start start 2022-05-02T09:39:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.401+0000 7f75dd9ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.401+0000 7f75dd9ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d81367e0 0x7f75d8145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.401+0000 7f75dd9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d8146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75dd9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d809ec20 con 0x7f75d8136bc0 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75dd9ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8093250 con 0x7f75d8066a80 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75dd9ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8092480 con 0x7f75d81367e0 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d81367e0 0x7f75d8145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50322/0 (socket says 172.21.15.50:50322) 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 -- 172.21.15.50:0/399231006 learned_addr learned my addr 172.21.15.50:0/399231006 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d77fe700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d8146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 -- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d81367e0 msgr2=0x7f75d8145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d81367e0 0x7f75d8145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 -- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 msgr2=0x7f75d8146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d8146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.402+0000 7f75d6ffd700 1 -- 172.21.15.50:0/399231006 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc00b1e0 con 0x7f75d8066a80 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75d6ffd700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f75c800c000 tx=0x7f75c8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c8010780 con 0x7f75d8066a80 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80108e0 con 0x7f75d8066a80 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8093530 con 0x7f75d8066a80 2022-05-02T09:39:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c8010c40 con 0x7f75d8066a80 2022-05-02T09:39:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.403+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d809ef90 con 0x7f75d8066a80 2022-05-02T09:39:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.404+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d809f1e0 con 0x7f75d8066a80 2022-05-02T09:39:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.404+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f75c801c460 con 0x7f75d8066a80 2022-05-02T09:39:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.405+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f75c804a660 con 0x7f75d8066a80 2022-05-02T09:39:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.408+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f75c80331d0 con 0x7f75d8066a80 2022-05-02T09:39:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.570+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d8067c40 con 0x7f75d8066a80 2022-05-02T09:39:25.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.571+0000 7f75c7fff700 1 -- 172.21.15.50:0/399231006 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2322 (secure 0 0 0) 0x7f75c8032dc0 con 0x7f75d8066a80 2022-05-02T09:39:25.573 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:25.573 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:15.328375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.572+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 >> v1:172.21.15.50:6800/30011 conn(0x7f75b4038940 legacy=0x7f75b403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.572+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 msgr2=0x7f75d8091bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.572+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f75c800c000 tx=0x7f75c8006df0).stop 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 shutdown_connections 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75d8136bc0 0x7f75d8146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75d8066a80 0x7f75d8091bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 --2- 172.21.15.50:0/399231006 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f75d81367e0 0x7f75d8145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 >> 172.21.15.50:0/399231006 conn(0x7f75d80a8690 msgr2=0x7f75d80a7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 shutdown_connections 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:25.573+0000 7f75dd9ff700 1 -- 172.21.15.50:0/399231006 wait complete. 2022-05-02T09:39:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2022-05-02T09:39:25.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:15.328375+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:25.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2022-05-02T09:39:25.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-05-02T09:39:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.104+0000 7f609b39d700 1 Processor -- start 2022-05-02T09:39:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.105+0000 7f609b39d700 1 -- start start 2022-05-02T09:39:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609b39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609b39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 0x7f609409a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609b39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60940618b0 con 0x7f6094135a10 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609b39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6094061b50 con 0x7f6094133160 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609b39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609409b950 con 0x7f6094132d80 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f6099b9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 0x7f609409a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49650/0 (socket says 172.21.15.50:49650) 2022-05-02T09:39:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.106+0000 7f609a39b700 1 -- 172.21.15.50:0/1678795861 learned_addr learned my addr 172.21.15.50:0/1678795861 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f609a39b700 1 -- 172.21.15.50:0/1678795861 >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 msgr2=0x7f609409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f609a39b700 1 --2- 172.21.15.50:0/1678795861 >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 0x7f609409a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f609a39b700 1 -- 172.21.15.50:0/1678795861 >> v1:172.21.15.50:6789/0 conn(0x7f6094135a10 legacy=0x7f6094135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f609a39b700 1 -- 172.21.15.50:0/1678795861 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609409bac0 con 0x7f6094132d80 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1678795861 >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 0x7f609409a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f609a39b700 1 --2- 172.21.15.50:0/1678795861 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6090002f70 tx=0x7f6090006eb0).ready entity=mon.2 client_cookie=359ed187c5257ac server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f6099399700 1 -- 172.21.15.50:0/1678795861 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609000d570 con 0x7f6094132d80 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f6099399700 1 -- 172.21.15.50:0/1678795861 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6090000e90 con 0x7f6094132d80 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.107+0000 7f6099399700 1 -- 172.21.15.50:0/1678795861 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609000d900 con 0x7f6094132d80 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 -- 172.21.15.50:0/1678795861 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 msgr2=0x7f6094061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 --2- 172.21.15.50:0/1678795861 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6090002f70 tx=0x7f6090006eb0).stop 2022-05-02T09:39:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 -- 172.21.15.50:0/1678795861 shutdown_connections 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 --2- 172.21.15.50:0/1678795861 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094132d80 0x7f6094061290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 --2- 172.21.15.50:0/1678795861 >> v2:172.21.15.50:3300/0 conn(0x7f6094133160 0x7f609409a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 -- 172.21.15.50:0/1678795861 >> 172.21.15.50:0/1678795861 conn(0x7f609406c300 msgr2=0x7f60940a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 -- 172.21.15.50:0/1678795861 shutdown_connections 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.108+0000 7f609b39d700 1 -- 172.21.15.50:0/1678795861 wait complete. 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.109+0000 7f609b39d700 1 Processor -- start 2022-05-02T09:39:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.109+0000 7f609b39d700 1 -- start start 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 0x7f609412c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094135a10 0x7f609412cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6094099710 con 0x7f6094133160 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6094092c10 con 0x7f6094132d80 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609b39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60940a9600 con 0x7f6094135a10 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 0x7f609412c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50324/0 (socket says 172.21.15.50:50324) 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609a39b700 1 -- 172.21.15.50:0/2542142288 learned_addr learned my addr 172.21.15.50:0/2542142288 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.110+0000 7f609ab9c700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094135a10 0x7f609412cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 -- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094135a10 msgr2=0x7f609412cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094135a10 0x7f609412cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 -- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 msgr2=0x7f609412c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 0x7f609412c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 -- 172.21.15.50:0/2542142288 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608400b180 con 0x7f6094132d80 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f6099b9a700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 0x7f609412c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f609a39b700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6094099850 tx=0x7f6090015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.111+0000 7f60837fe700 1 -- 172.21.15.50:0/2542142288 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6090011760 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.112+0000 7f60837fe700 1 -- 172.21.15.50:0/2542142288 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60900118c0 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.112+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609000b1e0 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.112+0000 7f60837fe700 1 -- 172.21.15.50:0/2542142288 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6090011c20 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.112+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6094092e40 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.113+0000 7f60837fe700 1 -- 172.21.15.50:0/2542142288 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f6090025030 con 0x7f6094132d80 2022-05-02T09:39:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.113+0000 7f60837fe700 1 -- 172.21.15.50:0/2542142288 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f609004b550 con 0x7f6094132d80 2022-05-02T09:39:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.117+0000 7f60b3c39b80 1 Processor -- start 2022-05-02T09:39:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.117+0000 7f60b3c39b80 1 -- start start 2022-05-02T09:39:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cdc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cdc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c122c236a0 con 0x55c122cdcaa0 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c122bf45b0 con 0x55c122cadde0 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c122c07a10 con 0x55c122c66bf0 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cdc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f609ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f609ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35754/0 (socket says 172.21.15.50:35754) 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f609ab9c700 1 -- 172.21.15.50:0/1117424475 learned_addr learned my addr 172.21.15.50:0/1117424475 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.118+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cdc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 -- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 msgr2=0x55c122cdc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cdc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 -- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 msgr2=0x55c122cdc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cdc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 -- 172.21.15.50:0/1117424475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c122bf76b0 con 0x55c122cdcaa0 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609ab9c700 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x55c122caf5f0 tx=0x7f608c007f10).ready entity=mon.0 client_cookie=c4cf4267f2e7c46e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609b39d700 1 -- 172.21.15.50:0/1117424475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608c010710 con 0x55c122cdcaa0 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609b39d700 1 -- 172.21.15.50:0/1117424475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c010870 con 0x55c122cdcaa0 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.119+0000 7f609b39d700 1 -- 172.21.15.50:0/1117424475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608c010bd0 con 0x55c122cdcaa0 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 msgr2=0x55c122ccd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x55c122caf5f0 tx=0x7f608c007f10).stop 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1117424475 shutdown_connections 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cdc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1117424475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cdc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1117424475 >> 172.21.15.50:0/1117424475 conn(0x55c122c7ccb0 msgr2=0x55c122c7bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1117424475 shutdown_connections 2022-05-02T09:39:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.120+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1117424475 wait complete. 2022-05-02T09:39:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.121+0000 7f60b3c39b80 1 -- start start 2022-05-02T09:39:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.121+0000 7f60b3c39b80 1 Processor -- start 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122cccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c122be84f0 con 0x55c122cdcaa0 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c122bd8510 con 0x55c122c66bf0 2022-05-02T09:39:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c122cd6bf0 con 0x55c122cadde0 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f60b3c39b80 10 client.0 ll_register_callbacks cb 0x55c122bfd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.122+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122cccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50328/0 (socket says 172.21.15.50:50328) 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 -- 172.21.15.50:0/4138971771 learned_addr learned my addr 172.21.15.50:0/4138971771 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 -- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 msgr2=0x55c122cccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122cccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 -- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 msgr2=0x55c122ccd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 -- 172.21.15.50:0/4138971771 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c00f040 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f609a39b700 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6090001e20 tx=0x7f609001e000).ready entity=mon.1 client_cookie=cde15c15d5474408 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f60713fb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3301/0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.123+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609001ebf0 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mon.1 v2:172.21.15.50:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f609001e630 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c122b7ee70 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6090029b80 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 10 client.4474 fetch_fsmap learned FSMap version 10 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x55c122bfffe0 con 0x55c122c66bf0 2022-05-02T09:39:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mon.1 v2:172.21.15.50:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c122b7ee70 con 0x55c122c66bf0 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mon.1 v2:172.21.15.50:3301/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f609001b030 con 0x55c122c66bf0 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 10 client.4474 fetch_fsmap finished waiting for FSMap version 10 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 10 client.4474 resolve_mds: resolved ID 'b' to GID 4254 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 20 client.4474 populate_metadata read hostname 'smithi050' 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 4 client.4474 mds_command: new command op to 4254 tid=0[{"prefix": "get_command_descriptions"}] 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.124+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 --> v1:172.21.15.50:6818/3538936663 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c122bfde00 con 0x55c122cd3a30 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.125+0000 7f60713fb700 10 client.4474 ms_handle_connect on v1:172.21.15.50:6818/3538936663 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.125+0000 7f60713fb700 1 -- 172.21.15.50:0/4138971771 <== mds.1 v1:172.21.15.50:6818/3538936663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55c122bfde00 con 0x55c122cd3a30 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.125+0000 7f60713fb700 10 client.4474 handle_command_reply: tid=0 2022-05-02T09:39:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 client.4474 shutdown 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 msgr2=0x55c122cd6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6090001e20 tx=0x7f609001e000).stop 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 shutdown_connections 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122ccd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122c66bf0 0x55c122cd6dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60713fb700 0 client.4474 ms_handle_reset on v1:172.21.15.50:6818/3538936663 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/4138971771 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122cccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 >> 172.21.15.50:0/4138971771 conn(0x55c122c7ccb0 msgr2=0x55c122cdc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 shutdown_connections 2022-05-02T09:39:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 1 -- 172.21.15.50:0/4138971771 wait complete. 2022-05-02T09:39:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.126+0000 7f60b3c39b80 20 client.4474 trim_cache size 0 max 16384 2022-05-02T09:39:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.143+0000 7f60b3c39b80 1 Processor -- start 2022-05-02T09:39:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 -- start start 2022-05-02T09:39:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 0x55c122c7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cdcaa0 0x55c122ccfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c122b7f0a0 con 0x55c122c66bf0 2022-05-02T09:39:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c122cd6aa0 con 0x55c122cdcaa0 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.144+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c122cceb50 con 0x55c122cadde0 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f609ab9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cdcaa0 0x55c122ccfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49658/0 (socket says 172.21.15.50:49658) 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 -- 172.21.15.50:0/1106680834 learned_addr learned my addr 172.21.15.50:0/1106680834 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f609a39b700 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 0x55c122c7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 -- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cdcaa0 msgr2=0x55c122ccfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cdcaa0 0x55c122ccfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 -- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 msgr2=0x55c122c7bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 0x55c122c7bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f6099b9a700 1 -- 172.21.15.50:0/1106680834 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c122bd6760 con 0x55c122cadde0 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.145+0000 7f609a39b700 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 0x55c122c7bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6084008000 tx=0x7f6084006df0).ready entity=mon.2 client_cookie=af4b4999326f5239 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60733ff700 1 -- 172.21.15.50:0/1106680834 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608401c070 con 0x55c122cadde0 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60733ff700 1 -- 172.21.15.50:0/1106680834 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084017570 con 0x55c122cadde0 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60733ff700 1 -- 172.21.15.50:0/1106680834 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60840178d0 con 0x55c122cadde0 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 msgr2=0x55c122ccf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6084008000 tx=0x7f6084006df0).stop 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1106680834 shutdown_connections 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cdcaa0 0x55c122ccfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122c66bf0 0x55c122c7bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1106680834 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122cadde0 0x55c122ccf6d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.146+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1106680834 >> 172.21.15.50:0/1106680834 conn(0x55c122c7ccb0 msgr2=0x55c122cd8290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.147+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1106680834 shutdown_connections 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.147+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1106680834 wait complete. 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.147+0000 7f60b3c39b80 1 -- start start 2022-05-02T09:39:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.147+0000 7f60b3c39b80 1 Processor -- start 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122cd4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c122cb3a80 con 0x55c122cdcaa0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c122cac4f0 con 0x55c122cadde0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c122d11710 con 0x55c122c66bf0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.148+0000 7f60b3c39b80 10 client.0 ll_register_callbacks cb 0x55c122cd8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122cd4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49660/0 (socket says 172.21.15.50:49660) 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 -- 172.21.15.50:0/1257533915 learned_addr learned my addr 172.21.15.50:0/1257533915 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f6099b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50332/0 (socket says 172.21.15.50:50332) 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 -- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 msgr2=0x55c122cd3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 -- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 msgr2=0x55c122cd4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122cd4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f609a39b700 1 -- 172.21.15.50:0/1257533915 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c122bfffe0 con 0x55c122c66bf0 2022-05-02T09:39:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.149+0000 7f6099b9a700 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f609a39b700 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x55c122d11b60 tx=0x7f6090035000).ready entity=mon.2 client_cookie=30c5557593c689ca server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3302/0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609001ebf0 con 0x55c122c66bf0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mon.2 v2:172.21.15.50:3302/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f609001e630 con 0x55c122c66bf0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f608c010870 con 0x55c122c66bf0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6090029b80 con 0x55c122c66bf0 2022-05-02T09:39:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 10 client.4478 fetch_fsmap learned FSMap version 10 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x7f60840136f0 con 0x55c122c66bf0 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mon.2 v2:172.21.15.50:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c010870 con 0x55c122c66bf0 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mon.2 v2:172.21.15.50:3302/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f60900295f0 con 0x55c122c66bf0 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 10 client.4478 fetch_fsmap finished waiting for FSMap version 10 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 10 client.4478 resolve_mds: resolved ID 'b' to GID 4254 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 20 client.4478 populate_metadata read hostname 'smithi050' 2022-05-02T09:39:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.150+0000 7f60b3c39b80 4 client.4478 mds_command: new command op to 4254 tid=0[{"prefix": "status"}] 2022-05-02T09:39:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 --> v1:172.21.15.50:6818/3538936663 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c122bf6140 con 0x55c122cd47f0 2022-05-02T09:39:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60723fd700 10 client.4478 ms_handle_connect on v1:172.21.15.50:6818/3538936663 2022-05-02T09:39:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60723fd700 1 -- 172.21.15.50:0/1257533915 <== mds.1 v1:172.21.15.50:6818/3538936663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+300 (unknown 0 0 3799372148) 0x55c122bf6140 con 0x55c122cd47f0 2022-05-02T09:39:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60723fd700 10 client.4478 handle_command_reply: tid=0 2022-05-02T09:39:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60b3c39b80 1 client.4478 shutdown 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.151+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 msgr2=0x55c122cb3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x55c122d11b60 tx=0x7f6090035000).stop 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 shutdown_connections 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c122c66bf0 0x55c122cb3c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c122cdcaa0 0x55c122cd4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60723fd700 0 client.4478 ms_handle_reset on v1:172.21.15.50:6818/3538936663 2022-05-02T09:39:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 --2- 172.21.15.50:0/1257533915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c122cadde0 0x55c122cd3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 >> 172.21.15.50:0/1257533915 conn(0x55c122c7ccb0 msgr2=0x55c122cd8290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 shutdown_connections 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 1 -- 172.21.15.50:0/1257533915 wait complete. 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.152+0000 7f60b3c39b80 20 client.4478 trim_cache size 0 max 16384 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:39:26.165 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "7c52b71c-589c-4ac2-936d-4a721101e437", 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4254, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.823921406, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 10, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 19, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 19, 2022-05-02T09:39:26.166 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 25.332795995000001 2022-05-02T09:39:26.167 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 >> v1:172.21.15.50:6800/30011 conn(0x7f6074038b20 legacy=0x7f607403afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 msgr2=0x7f6094092590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6094099850 tx=0x7f6090015000).stop 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 shutdown_connections 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6094135a10 0x7f609412cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6094132d80 0x7f6094092590 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 --2- 172.21.15.50:0/2542142288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6094133160 0x7f609412c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 >> 172.21.15.50:0/2542142288 conn(0x7f609406c300 msgr2=0x7f609412ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 shutdown_connections 2022-05-02T09:39:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.153+0000 7f609b39d700 1 -- 172.21.15.50:0/2542142288 wait complete. 2022-05-02T09:39:26.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-05-02T09:39:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.381+0000 7f06575ff700 1 Processor -- start 2022-05-02T09:39:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.381+0000 7f06575ff700 1 -- start start 2022-05-02T09:39:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.382+0000 7f06575ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0650133280 0x7f0650139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.382+0000 7f06575ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 0x7f0650135e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.382+0000 7f06575ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065005da20 con 0x7f0650136370 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.382+0000 7f06575ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650139a30 con 0x7f0650133280 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.382+0000 7f06575ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0650139cd0 con 0x7f0650133660 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0650133280 0x7f0650139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f0654b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 0x7f0650135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0650133280 0x7f0650139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35764/0 (socket says 172.21.15.50:35764) 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f0654b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 0x7f0650135e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50336/0 (socket says 172.21.15.50:50336) 2022-05-02T09:39:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 -- 172.21.15.50:0/1443593007 learned_addr learned my addr 172.21.15.50:0/1443593007 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f0655b9c700 1 --1- 172.21.15.50:0/1443593007 >> v1:172.21.15.50:6789/0 conn(0x7f0650136370 0x7f06501407b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52208/0 (socket says 172.21.15.50:52208) 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 -- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 msgr2=0x7f0650135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 --2- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 0x7f0650135e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 -- 172.21.15.50:0/1443593007 >> v1:172.21.15.50:6789/0 conn(0x7f0650136370 legacy=0x7f06501407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.383+0000 7f065539b700 1 -- 172.21.15.50:0/1443593007 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500a80f0 con 0x7f0650133280 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f065539b700 1 --2- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650139410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c006eb0).ready entity=mon.0 client_cookie=3f12d0b85c3f82d4 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f063ffff700 1 -- 172.21.15.50:0/1443593007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00d570 con 0x7f0650133280 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f063ffff700 1 -- 172.21.15.50:0/1443593007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c000e90 con 0x7f0650133280 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f063ffff700 1 -- 172.21.15.50:0/1443593007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00d900 con 0x7f0650133280 2022-05-02T09:39:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f06575ff700 1 -- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 msgr2=0x7f0650139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.384+0000 7f06575ff700 1 --2- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650139410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c006eb0).stop 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 -- 172.21.15.50:0/1443593007 shutdown_connections 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 --2- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650139410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 --2- 172.21.15.50:0/1443593007 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650133660 0x7f0650135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 -- 172.21.15.50:0/1443593007 >> 172.21.15.50:0/1443593007 conn(0x7f0650066e20 msgr2=0x7f065005fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 -- 172.21.15.50:0/1443593007 shutdown_connections 2022-05-02T09:39:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.385+0000 7f06575ff700 1 -- 172.21.15.50:0/1443593007 wait complete. 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.386+0000 7f06575ff700 1 Processor -- start 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.386+0000 7f06575ff700 1 -- start start 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0650133660 0x7f0650148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 0x7f0650149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0650132e80 con 0x7f0650133280 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0650133010 con 0x7f0650136370 2022-05-02T09:39:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f06575ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0650115150 con 0x7f0650133660 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35768/0 (socket says 172.21.15.50:35768) 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f065539b700 1 -- 172.21.15.50:0/3519940292 learned_addr learned my addr 172.21.15.50:0/3519940292 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f0654b9a700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0650133660 0x7f0650148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.387+0000 7f0655b9c700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 0x7f0650149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 -- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0650133660 msgr2=0x7f0650148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0650133660 0x7f0650148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 -- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 msgr2=0x7f0650149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 0x7f0650149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 -- 172.21.15.50:0/3519940292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c00b1e0 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f0655b9c700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 0x7f0650149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f065539b700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f063e7fc700 1 -- 172.21.15.50:0/3519940292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c011610 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f063e7fc700 1 -- 172.21.15.50:0/3519940292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c011770 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650116060 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.388+0000 7f063e7fc700 1 -- 172.21.15.50:0/3519940292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c011ad0 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.389+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500a5f70 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.390+0000 7f063e7fc700 1 -- 172.21.15.50:0/3519940292 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f064c025030 con 0x7f0650133280 2022-05-02T09:39:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.391+0000 7f063e7fc700 1 -- 172.21.15.50:0/3519940292 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f064c04b470 con 0x7f0650133280 2022-05-02T09:39:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.394+0000 7f066ede0b80 1 Processor -- start 2022-05-02T09:39:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 -- start start 2022-05-02T09:39:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f60798ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f60799450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f607106a0 con 0x559f60798fd0 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f606e15b0 con 0x559f607c6870 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.395+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x559f606f4a10 con 0x559f60753bf0 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49664/0 (socket says 172.21.15.50:49664) 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 -- 172.21.15.50:0/1702881408 learned_addr learned my addr 172.21.15.50:0/1702881408 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f0655b9c700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f60799450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f0654b9a700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f60798ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 -- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 msgr2=0x559f60798ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f60798ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 -- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 msgr2=0x559f60799450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f60799450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f065539b700 1 -- 172.21.15.50:0/1702881408 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f606e46b0 con 0x559f60753bf0 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.396+0000 7f0655b9c700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f60799450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f065539b700 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x559f607bcad0 tx=0x7f064c01e000).ready entity=mon.2 client_cookie=e8bb68712ca1c486 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f06575ff700 1 -- 172.21.15.50:0/1702881408 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c029da0 con 0x559f60753bf0 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f06575ff700 1 -- 172.21.15.50:0/1702881408 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c029bc0 con 0x559f60753bf0 2022-05-02T09:39:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f06575ff700 1 -- 172.21.15.50:0/1702881408 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c028440 con 0x559f60753bf0 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f066ede0b80 1 -- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 msgr2=0x559f6079aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.397+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x559f607bcad0 tx=0x7f064c01e000).stop 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 -- 172.21.15.50:0/1702881408 shutdown_connections 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f6079aa30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f60799450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1702881408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f60798ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 -- 172.21.15.50:0/1702881408 >> 172.21.15.50:0/1702881408 conn(0x559f60769cb0 msgr2=0x559f60768cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 -- 172.21.15.50:0/1702881408 shutdown_connections 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 -- 172.21.15.50:0/1702881408 wait complete. 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.398+0000 7f066ede0b80 1 -- start start 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.399+0000 7f066ede0b80 1 Processor -- start 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60798fd0 0x559f607ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 0x559f607ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f606d54f0 con 0x559f607c6870 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f606c5510 con 0x559f60753bf0 2022-05-02T09:39:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x559f607baa80 con 0x559f60798fd0 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f066ede0b80 10 client.0 ll_register_callbacks cb 0x559f606ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50344/0 (socket says 172.21.15.50:50344) 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f065539b700 1 -- 172.21.15.50:0/835792998 learned_addr learned my addr 172.21.15.50:0/835792998 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f0655b9c700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 0x559f607ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f0654b9a700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60798fd0 0x559f607ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.400+0000 7f065539b700 1 -- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60798fd0 msgr2=0x559f607ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f065539b700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60798fd0 0x559f607ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f065539b700 1 -- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 msgr2=0x559f607ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f065539b700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 0x559f607ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f065539b700 1 -- 172.21.15.50:0/835792998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065005da20 con 0x559f60753bf0 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f0655b9c700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 0x559f607ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f065539b700 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x559f607c1480 tx=0x7f064c034000).ready entity=mon.1 client_cookie=851afafdc83e99da server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f062bfff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3301/0 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c029da0 con 0x559f60753bf0 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mon.1 v2:172.21.15.50:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f064c029960 con 0x559f60753bf0 2022-05-02T09:39:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f60720de0 con 0x559f60753bf0 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f064c020c60 con 0x559f60753bf0 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f066ede0b80 10 client.4489 fetch_fsmap learned FSMap version 10 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x7f06500a5f70 con 0x559f60753bf0 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.401+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mon.1 v2:172.21.15.50:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f60720de0 con 0x559f60753bf0 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mon.1 v2:172.21.15.50:3301/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f064c01b030 con 0x559f60753bf0 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f066ede0b80 10 client.4489 fetch_fsmap finished waiting for FSMap version 10 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f066ede0b80 10 client.4489 resolve_mds: resolved ID 'c' to GID 4257 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f066ede0b80 20 client.4489 populate_metadata read hostname 'smithi050' 2022-05-02T09:39:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f066ede0b80 4 client.4489 mds_command: new command op to 4257 tid=0[{"prefix": "get_command_descriptions"}] 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f606eae00 con 0x559f607c5f80 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.402+0000 7f062bfff700 10 client.4489 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f062bfff700 1 -- 172.21.15.50:0/835792998 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x559f606eae00 con 0x559f607c5f80 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f062bfff700 10 client.4489 handle_command_reply: tid=0 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 client.4489 shutdown 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 msgr2=0x559f607b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x559f607c1480 tx=0x7f064c034000).stop 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 shutdown_connections 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f607c6870 0x559f607ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60753bf0 0x559f607b9bb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 --2- 172.21.15.50:0/835792998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60798fd0 0x559f607ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f062bfff700 0 client.4489 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.403+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 >> 172.21.15.50:0/835792998 conn(0x559f60769cb0 msgr2=0x559f60799430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.404+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 shutdown_connections 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.404+0000 7f066ede0b80 1 -- 172.21.15.50:0/835792998 wait complete. 2022-05-02T09:39:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.404+0000 7f066ede0b80 20 client.4489 trim_cache size 0 max 16384 2022-05-02T09:39:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.421+0000 7f066ede0b80 1 Processor -- start 2022-05-02T09:39:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.421+0000 7f066ede0b80 1 -- start start 2022-05-02T09:39:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.421+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f607c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f607c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f606c98f0 con 0x559f60798fd0 2022-05-02T09:39:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f607bb910 con 0x559f607c6870 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x559f607c1970 con 0x559f60753bf0 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49668/0 (socket says 172.21.15.50:49668) 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 -- 172.21.15.50:0/1544628239 learned_addr learned my addr 172.21.15.50:0/1544628239 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f0654b9a700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f607c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f0655b9c700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f607c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 -- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 msgr2=0x559f607c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f607c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 -- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 msgr2=0x559f607c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f607c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f065539b700 1 -- 172.21.15.50:0/1544628239 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f606ecfe0 con 0x559f60753bf0 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.422+0000 7f0654b9a700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f607c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f065539b700 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x559f6066c100 tx=0x7f064c03f000).ready entity=mon.2 client_cookie=2068ada16f1c3814 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f06363ff700 1 -- 172.21.15.50:0/1544628239 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c029da0 con 0x559f60753bf0 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f06363ff700 1 -- 172.21.15.50:0/1544628239 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c020c60 con 0x559f60753bf0 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f06363ff700 1 -- 172.21.15.50:0/1544628239 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c04a0d0 con 0x559f60753bf0 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 -- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 msgr2=0x559f607bca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x559f6066c100 tx=0x7f064c03f000).stop 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 -- 172.21.15.50:0/1544628239 shutdown_connections 2022-05-02T09:39:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f60753bf0 0x559f607bca50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f607c6870 0x559f607c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 --2- 172.21.15.50:0/1544628239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60798fd0 0x559f607c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.423+0000 7f066ede0b80 1 -- 172.21.15.50:0/1544628239 >> 172.21.15.50:0/1544628239 conn(0x559f60769cb0 msgr2=0x559f6079bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.424+0000 7f066ede0b80 1 -- 172.21.15.50:0/1544628239 shutdown_connections 2022-05-02T09:39:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.424+0000 7f066ede0b80 1 -- 172.21.15.50:0/1544628239 wait complete. 2022-05-02T09:39:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.424+0000 7f066ede0b80 1 -- start start 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.424+0000 7f066ede0b80 1 Processor -- start 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60753bf0 0x559f6079edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f607c6870 0x559f60823be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f607695f0 con 0x559f60753bf0 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f6079df60 con 0x559f60798fd0 2022-05-02T09:39:26.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x559f607bc7b0 con 0x559f607c6870 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.425+0000 7f066ede0b80 10 client.0 ll_register_callbacks cb 0x559f607c5cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50348/0 (socket says 172.21.15.50:50348) 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 -- 172.21.15.50:0/2006449426 learned_addr learned my addr 172.21.15.50:0/2006449426 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0655b9c700 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f607c6870 0x559f60823be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f065539b700 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60753bf0 0x559f6079edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 -- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f607c6870 msgr2=0x559f60823be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f607c6870 0x559f60823be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 -- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60753bf0 msgr2=0x559f6079edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60753bf0 0x559f6079edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 -- 172.21.15.50:0/2006449426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500a5f70 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f0654b9a700 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x559f607bc550 tx=0x7f0640019040).ready entity=mon.1 client_cookie=92d998854bf4c944 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.426+0000 7f06353fd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3301/0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064001c040 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mon.1 v2:172.21.15.50:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0640016630 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f064c029bc0 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06400167f0 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 10 client.4495 fetch_fsmap learned FSMap version 10 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x559f6055f990 con 0x559f60798fd0 2022-05-02T09:39:26.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mon.1 v2:172.21.15.50:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c029bc0 con 0x559f60798fd0 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mon.1 v2:172.21.15.50:3301/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f0640013070 con 0x559f60798fd0 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 10 client.4495 fetch_fsmap finished waiting for FSMap version 10 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 10 client.4495 resolve_mds: resolved ID 'c' to GID 4257 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 20 client.4495 populate_metadata read hostname 'smithi050' 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 4 client.4495 mds_command: new command op to 4257 tid=0[{"prefix": "status"}] 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.427+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f606e3140 con 0x559f6079d560 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f06353fd700 10 client.4495 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f06353fd700 1 -- 172.21.15.50:0/2006449426 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 2135948885) 0x559f606e3140 con 0x559f6079d560 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f06353fd700 10 client.4495 handle_command_reply: tid=0 2022-05-02T09:39:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f066ede0b80 1 client.4495 shutdown 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 msgr2=0x559f608236f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.428+0000 7f066ede0b80 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x559f607bc550 tx=0x7f0640019040).stop 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 shutdown_connections 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x559f607c6870 0x559f60823be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f06353fd700 0 client.4495 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f60753bf0 0x559f6079edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 --2- 172.21.15.50:0/2006449426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559f60798fd0 0x559f608236f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 >> 172.21.15.50:0/2006449426 conn(0x559f60769cb0 msgr2=0x559f607993b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 shutdown_connections 2022-05-02T09:39:26.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 1 -- 172.21.15.50:0/2006449426 wait complete. 2022-05-02T09:39:26.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.429+0000 7f066ede0b80 20 client.4495 trim_cache size 0 max 16384 2022-05-02T09:39:26.439 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:39:26.443 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "7c52b71c-589c-4ac2-936d-4a721101e437", 2022-05-02T09:39:26.443 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2022-05-02T09:39:26.443 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4257, 2022-05-02T09:39:26.443 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2022-05-02T09:39:26.449 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 15.124338294999999, 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 10, 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 19, 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 19, 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 25.603881134000002 2022-05-02T09:39:26.450 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:39:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 >> v1:172.21.15.50:6800/30011 conn(0x7f06300389d0 legacy=0x7f063003ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 msgr2=0x7f0650115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c015000).stop 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 shutdown_connections 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0650136370 0x7f0650149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0650133280 0x7f0650115b70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 --2- 172.21.15.50:0/3519940292 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0650133660 0x7f0650148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 >> 172.21.15.50:0/3519940292 conn(0x7f0650066e20 msgr2=0x7f065006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 shutdown_connections 2022-05-02T09:39:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.430+0000 7f06575ff700 1 -- 172.21.15.50:0/3519940292 wait complete. 2022-05-02T09:39:26.454 INFO:teuthology.run_tasks:Running task exec... 2022-05-02T09:39:26.466 INFO:teuthology.task.exec:Executing custom commands... 2022-05-02T09:39:26.466 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:39:26.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2022-05-02T09:39:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.663+0000 7fd5d759e700 1 Processor -- start 2022-05-02T09:39:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.663+0000 7fd5d759e700 1 -- start start 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 0x7fd5d805cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5d80a8670 0x7fd5d8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d805fcf0 0x7fd5d8060160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d8136d30 con 0x7fd5d80a8670 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d805c040 con 0x7fd5d805fcf0 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.664+0000 7fd5d759e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80a7a50 con 0x7fd5d8136460 2022-05-02T09:39:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 0x7fd5d805cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5d80a8670 0x7fd5d8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5d80a8670 0x7fd5d8136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35778/0 (socket says 172.21.15.50:35778) 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 0x7fd5d805cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49672/0 (socket says 172.21.15.50:49672) 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 -- 172.21.15.50:0/367365026 learned_addr learned my addr 172.21.15.50:0/367365026 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d6d9d700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d805fcf0 0x7fd5d8060160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 -- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 msgr2=0x7fd5d805cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 0x7fd5d805cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 -- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d805fcf0 msgr2=0x7fd5d8060160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d805fcf0 0x7fd5d8060160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 -- 172.21.15.50:0/367365026 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80a7d10 con 0x7fd5d80a8670 2022-05-02T09:39:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.665+0000 7fd5d5d9b700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d80a8670 0x7fd5d8136840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd5cc002f70 tx=0x7fd5cc006eb0).ready entity=mon.0 client_cookie=71de84b3c83c3514 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d559a700 1 -- 172.21.15.50:0/367365026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5cc00d570 con 0x7fd5d80a8670 2022-05-02T09:39:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d559a700 1 -- 172.21.15.50:0/367365026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc000e90 con 0x7fd5d80a8670 2022-05-02T09:39:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d559a700 1 -- 172.21.15.50:0/367365026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5cc00d900 con 0x7fd5d80a8670 2022-05-02T09:39:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 -- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d80a8670 msgr2=0x7fd5d8136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d80a8670 0x7fd5d8136840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd5cc002f70 tx=0x7fd5cc006eb0).stop 2022-05-02T09:39:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 -- 172.21.15.50:0/367365026 shutdown_connections 2022-05-02T09:39:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d805fcf0 0x7fd5d8060160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d8136460 0x7fd5d805cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 --2- 172.21.15.50:0/367365026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d80a8670 0x7fd5d8136840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 -- 172.21.15.50:0/367365026 >> 172.21.15.50:0/367365026 conn(0x7fd5d80611f0 msgr2=0x7fd5d8066940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.666+0000 7fd5d759e700 1 -- 172.21.15.50:0/367365026 shutdown_connections 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.667+0000 7fd5d759e700 1 -- 172.21.15.50:0/367365026 wait complete. 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.668+0000 7fd5d759e700 1 Processor -- start 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.668+0000 7fd5d759e700 1 -- start start 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 0x7fd5d8145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d8136460 0x7fd5d8146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8113d40 con 0x7fd5d805fcf0 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8132f00 con 0x7fd5d8136460 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d759e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8115fa0 con 0x7fd5d80a8670 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d5d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 0x7fd5d8145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35780/0 (socket says 172.21.15.50:35780) 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d659c700 1 -- 172.21.15.50:0/2792340401 learned_addr learned my addr 172.21.15.50:0/2792340401 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d5d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 0x7fd5d8145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49674/0 (socket says 172.21.15.50:49674) 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.669+0000 7fd5d6d9d700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d8136460 0x7fd5d8146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 -- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 msgr2=0x7fd5d8145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 0x7fd5d8145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 -- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d8136460 msgr2=0x7fd5d8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d8136460 0x7fd5d8146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 -- 172.21.15.50:0/2792340401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc00b1e0 con 0x7fd5d805fcf0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d659c700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd5c800c000 tx=0x7fd5c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8011750 con 0x7fd5d805fcf0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80118b0 con 0x7fd5d805fcf0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8145820 con 0x7fd5d805fcf0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8011c10 con 0x7fd5d805fcf0 2022-05-02T09:39:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.670+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8138c60 con 0x7fd5d805fcf0 2022-05-02T09:39:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.672+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fd5c8011d70 con 0x7fd5d805fcf0 2022-05-02T09:39:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.672+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d80a6b80 con 0x7fd5d805fcf0 2022-05-02T09:39:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.672+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd5c804a840 con 0x7fd5d805fcf0 2022-05-02T09:39:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.675+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd5c80332a0 con 0x7fd5d805fcf0 2022-05-02T09:39:26.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:26.811+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7fd5d8114bb0 con 0x7fd5d805fcf0 2022-05-02T09:39:27.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.566+0000 7fd5c77fe700 1 -- 172.21.15.50:0/2792340401 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd5c8032e90 con 0x7fd5d805fcf0 2022-05-02T09:39:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.572+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 >> v1:172.21.15.50:6800/30011 conn(0x7fd5b40389d0 legacy=0x7fd5b403ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.572+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 msgr2=0x7fd5d8115960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.572+0000 7fd5d759e700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd5c800c000 tx=0x7fd5c8006df0).stop 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.573+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 shutdown_connections 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.573+0000 7fd5d759e700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd5d8136460 0x7fd5d8146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.573+0000 7fd5d759e700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5d805fcf0 0x7fd5d8115960 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0x7fd5c800c000 tx=0x7fd5c8006df0).stop 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.573+0000 7fd5d759e700 1 --2- 172.21.15.50:0/2792340401 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd5d80a8670 0x7fd5d8145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.573+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 >> 172.21.15.50:0/2792340401 conn(0x7fd5d80611f0 msgr2=0x7fd5d80a9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.574+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 shutdown_connections 2022-05-02T09:39:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:27.574+0000 7fd5d759e700 1 -- 172.21.15.50:0/2792340401 wait complete. 2022-05-02T09:39:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:set require_min_compat_client to octopus 2022-05-02T09:39:27.601 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:39:27.613 INFO:teuthology.task.print:**** done ceph 2022-05-02T09:39:27.613 INFO:teuthology.run_tasks:Running task ceph-fuse... 2022-05-02T09:39:27.662 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2022-05-02T09:39:27.662 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2022-05-02T09:39:27.663 INFO:tasks.ceph_fuse:client.0 config is {} 2022-05-02T09:39:27.663 INFO:tasks.ceph_fuse:client.1 config is {} 2022-05-02T09:39:27.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:27.664 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2022-05-02T09:39:27.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:27.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2022-05-02T09:39:27.818 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2022-05-02T09:39:27.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:39:27.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:27.823 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2022-05-02T09:39:27.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:27.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2022-05-02T09:39:27.978 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2022-05-02T09:39:27.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:39:27.983 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2022-05-02T09:39:27.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-05-02T09:39:28.196 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.194+0000 7f6a2919d700 1 Processor -- start 2022-05-02T09:39:28.196 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.194+0000 7f6a2919d700 1 -- start start 2022-05-02T09:39:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a24139b00 0x7f6a2405d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 0x7f6a2405fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24139010 con 0x7f6a24139b00 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241392d0 con 0x7f6a2405cc50 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2919d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240a7c50 con 0x7f6a24139720 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a23fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2899c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 0x7f6a2405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a23fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49676/0 (socket says 172.21.15.50:49676) 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a237fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a24139b00 0x7f6a2405d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a2899c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 0x7f6a2405fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50356/0 (socket says 172.21.15.50:50356) 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.195+0000 7f6a23fff700 1 -- 172.21.15.50:0/2517912945 learned_addr learned my addr 172.21.15.50:0/2517912945 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 -- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 msgr2=0x7f6a2405fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 --2- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 0x7f6a2405fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 -- 172.21.15.50:0/2517912945 >> v2:172.21.15.50:3300/0 conn(0x7f6a24139b00 msgr2=0x7f6a2405d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 --2- 172.21.15.50:0/2517912945 >> v2:172.21.15.50:3300/0 conn(0x7f6a24139b00 0x7f6a2405d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 -- 172.21.15.50:0/2517912945 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240a95d0 con 0x7f6a24139720 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a23fff700 1 --2- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6a14002f70 tx=0x7f6a14006eb0).ready entity=mon.2 client_cookie=ad5bb03307adc6c1 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a22ffd700 1 -- 172.21.15.50:0/2517912945 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400d570 con 0x7f6a24139720 2022-05-02T09:39:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a22ffd700 1 -- 172.21.15.50:0/2517912945 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14000e90 con 0x7f6a24139720 2022-05-02T09:39:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.196+0000 7f6a22ffd700 1 -- 172.21.15.50:0/2517912945 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400d900 con 0x7f6a24139720 2022-05-02T09:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 -- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 msgr2=0x7f6a2405b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 --2- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6a14002f70 tx=0x7f6a14006eb0).stop 2022-05-02T09:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 -- 172.21.15.50:0/2517912945 shutdown_connections 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 --2- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a2405cc50 0x7f6a2405fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 --2- 172.21.15.50:0/2517912945 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a24139720 0x7f6a2405b8a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 --2- 172.21.15.50:0/2517912945 >> v2:172.21.15.50:3300/0 conn(0x7f6a24139b00 0x7f6a2405d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 -- 172.21.15.50:0/2517912945 >> 172.21.15.50:0/2517912945 conn(0x7f6a240669d0 msgr2=0x7f6a240a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 -- 172.21.15.50:0/2517912945 shutdown_connections 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.197+0000 7f6a2919d700 1 -- 172.21.15.50:0/2517912945 wait complete. 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.198+0000 7f6a2919d700 1 Processor -- start 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.198+0000 7f6a2919d700 1 -- start start 2022-05-02T09:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a2405cc50 0x7f6a240a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a24139b00 0x7f6a2412bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240a2500 con 0x7f6a24139720 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24132e40 con 0x7f6a24139b00 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.199+0000 7f6a2919d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24133100 con 0x7f6a2405cc50 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a23fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a2405cc50 0x7f6a240a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2022-05-02T09:39:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 -- 172.21.15.50:0/3780603354 learned_addr learned my addr 172.21.15.50:0/3780603354 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a2899c700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a24139b00 0x7f6a2412bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 -- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a2405cc50 msgr2=0x7f6a240a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a2405cc50 0x7f6a240a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 -- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a24139b00 msgr2=0x7f6a2412bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a24139b00 0x7f6a2412bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 -- 172.21.15.50:0/3780603354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1400b1e0 con 0x7f6a24139720 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.200+0000 7f6a237fe700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a1800c000 tx=0x7f6a18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.201+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18011750 con 0x7f6a24139720 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.201+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a180118b0 con 0x7f6a24139720 2022-05-02T09:39:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.201+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18011c10 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.201+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240a0630 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.201+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a24132ab0 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.202+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2405d100 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.202+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f6a18011d70 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.203+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6a1804a5e0 con 0x7f6a24139720 2022-05-02T09:39:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.206+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6a1802f720 con 0x7f6a24139720 2022-05-02T09:39:28.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.361+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a24057990 con 0x7f6a24139720 2022-05-02T09:39:28.364 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.362+0000 7f6a217fa700 1 -- 172.21.15.50:0/3780603354 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a18032d40 con 0x7f6a24139720 2022-05-02T09:39:28.365 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2022-05-02T09:39:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.363+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 >> v1:172.21.15.50:6800/30011 conn(0x7f6a04038940 legacy=0x7f6a0403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.363+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 msgr2=0x7f6a241325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.363+0000 7f6a2919d700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a1800c000 tx=0x7f6a18006df0).stop 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 shutdown_connections 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f6a2405cc50 0x7f6a240a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6a24139b00 0x7f6a2412bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 --2- 172.21.15.50:0/3780603354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a24139720 0x7f6a241325c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 >> 172.21.15.50:0/3780603354 conn(0x7f6a240669d0 msgr2=0x7f6a24137330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 shutdown_connections 2022-05-02T09:39:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:28.364+0000 7f6a2919d700 1 -- 172.21.15.50:0/3780603354 wait complete. 2022-05-02T09:39:28.389 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-05-02T09:39:28.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-05-02T09:39:28.390 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-05-02T09:39:28.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:28.391 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2022-05-02T09:39:28.448 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42718sec preferred_lft 42718sec 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2022-05-02T09:39:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:28.452 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-05-02T09:39:28.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-05-02T09:39:28.453 DEBUG:teuthology.orchestra.run.smithi073:> ') 2022-05-02T09:39:28.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:28.771 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-05-02T09:39:28.918 INFO:teuthology.orchestra.run.smithi073.stdout:1 2022-05-02T09:39:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:28.923 DEBUG:teuthology.orchestra.run.smithi073:> route 2022-05-02T09:39:29.011 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2022-05-02T09:39:29.011 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-05-02T09:39:29.012 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-05-02T09:39:29.012 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-05-02T09:39:29.013 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-05-02T09:39:29.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:29.015 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2022-05-02T09:39:29.015 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2022-05-02T09:39:29.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-05-02T09:39:29.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-05-02T09:39:29.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-05-02T09:39:29.016 DEBUG:teuthology.orchestra.run.smithi073:> ') 2022-05-02T09:39:29.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:29.418 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2022-05-02T09:39:29.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:29.477 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2022-05-02T09:39:29.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:29.535 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2022-05-02T09:39:29.535 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2022-05-02T09:39:29.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-05-02T09:39:29.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-05-02T09:39:29.535 DEBUG:teuthology.orchestra.run.smithi073:> ') 2022-05-02T09:39:29.715 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-05-02T09:39:29.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-05-02T09:39:29.716 DEBUG:teuthology.orchestra.run.smithi073:> ') 2022-05-02T09:39:30.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:30.041 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2022-05-02T09:39:30.041 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2022-05-02T09:39:30.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2022-05-02T09:39:30.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2022-05-02T09:39:30.041 DEBUG:teuthology.orchestra.run.smithi073:> ') 2022-05-02T09:39:30.253 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-05-02T09:39:30.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-05-02T09:39:30.253 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:30.310 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-05-02T09:39:30.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-05-02T09:39:30.311 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:30.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2022-05-02T09:39:30.455 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-05-02T09:39:30.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-05-02T09:39:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-05-02T09:39:30.544 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-05-02T09:39:30.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:30.545 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2022-05-02T09:39:30.602 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-05-02T09:39:30.602 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2022-05-02T09:39:30.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2022-05-02T09:39:30.697 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-05-02T09:39:30.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-05-02T09:39:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-05-02T09:39:30.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-05-02T09:39:30.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:30.823 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2022-05-02T09:39:30.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2022-05-02T09:39:30.827+0000 7f833a78f200 -1 init, newargv = 0x562edf8469c0 newargc=9 2022-05-02T09:39:30.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[28270]: starting ceph client 2022-05-02T09:39:30.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[28270]: starting fuse 2022-05-02T09:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout:43 2022-05-02T09:39:30.886 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2022-05-02T09:39:30.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-05-02T09:39:30.886 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2022-05-02T09:39:30.886 DEBUG:teuthology.orchestra.run.smithi073:> import re 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> import os 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2022-05-02T09:39:30.887 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2022-05-02T09:39:30.888 DEBUG:teuthology.orchestra.run.smithi073:> return f 2022-05-02T09:39:30.889 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-05-02T09:39:30.889 DEBUG:teuthology.orchestra.run.smithi073:> 2022-05-02T09:39:30.889 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2022-05-02T09:39:30.889 DEBUG:teuthology.orchestra.run.smithi073:> ' 2022-05-02T09:39:31.095 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.28270.asok 2022-05-02T09:39:31.272 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28270.asok 2022-05-02T09:39:31.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:31.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28270.asok status 2022-05-02T09:39:31.459 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2022-05-02T09:39:31.459 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2022-05-02T09:39:31.459 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "d46a73d6d0a67a79558054a3a5a72cb561724974", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.16 (d46a73d6d0a67a79558054a3a5a72cb561724974) octopus (stable)", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "28270", 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2022-05-02T09:39:31.460 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4695, 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4695 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2022-05-02T09:39:31.461 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3256376979 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3256376979 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4695 172.21.15.73:0/3256376979", 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/3256376979", 2022-05-02T09:39:31.462 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 10, 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 20, 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2022-05-02T09:39:31.463 INFO:teuthology.orchestra.run.smithi073.stdout:} 2022-05-02T09:39:31.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-05-02T09:39:31.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.690+0000 7efbfd79d700 1 Processor -- start 2022-05-02T09:39:31.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.690+0000 7efbfd79d700 1 -- start start 2022-05-02T09:39:31.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.691+0000 7efbfd79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 0x7efbf8066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:31.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.691+0000 7efbfd79d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 0x7efbf81364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:31.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.691+0000 7efbfd79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80664a0 con 0x7efbf8139120 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbfd79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80a3330 con 0x7efbf8136100 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbfd79d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a35d0 con 0x7efbf8065ad0 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf77fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 0x7efbf81364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbfcf9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efbf8139120 0x7efbf8139570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52210/0 (socket says 172.21.15.50:52210) 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 0x7efbf8066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbfcf9c700 1 -- 172.21.15.50:0/4063216923 learned_addr learned my addr 172.21.15.50:0/4063216923 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf77fe700 1 -- 172.21.15.50:0/4063216923 >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 msgr2=0x7efbf8066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf77fe700 1 --2- 172.21.15.50:0/4063216923 >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 0x7efbf8066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf77fe700 1 -- 172.21.15.50:0/4063216923 >> v1:172.21.15.50:6789/0 conn(0x7efbf8139120 legacy=0x7efbf8139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf77fe700 1 -- 172.21.15.50:0/4063216923 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80605a0 con 0x7efbf8065ad0 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.692+0000 7efbf7fff700 1 --2- 172.21.15.50:0/4063216923 >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 0x7efbf8066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbf77fe700 1 --2- 172.21.15.50:0/4063216923 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 0x7efbf81364e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efbec002f70 tx=0x7efbec006df0).ready entity=mon.2 client_cookie=6216a23c6f914633 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbf6ffd700 1 -- 172.21.15.50:0/4063216923 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec00d570 con 0x7efbf8065ad0 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbf6ffd700 1 -- 172.21.15.50:0/4063216923 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec000e90 con 0x7efbf8065ad0 2022-05-02T09:39:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbf6ffd700 1 -- 172.21.15.50:0/4063216923 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec00d8c0 con 0x7efbf8065ad0 2022-05-02T09:39:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbfd79d700 1 -- 172.21.15.50:0/4063216923 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 msgr2=0x7efbf81364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.693+0000 7efbfd79d700 1 --2- 172.21.15.50:0/4063216923 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 0x7efbf81364e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efbec002f70 tx=0x7efbec006df0).stop 2022-05-02T09:39:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 -- 172.21.15.50:0/4063216923 shutdown_connections 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 --2- 172.21.15.50:0/4063216923 >> v2:172.21.15.50:3300/0 conn(0x7efbf8136100 0x7efbf8066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 --2- 172.21.15.50:0/4063216923 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8065ad0 0x7efbf81364e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 -- 172.21.15.50:0/4063216923 >> 172.21.15.50:0/4063216923 conn(0x7efbf80a9030 msgr2=0x7efbf80a5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 -- 172.21.15.50:0/4063216923 shutdown_connections 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.694+0000 7efbfd79d700 1 -- 172.21.15.50:0/4063216923 wait complete. 2022-05-02T09:39:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.695+0000 7efbfd79d700 1 Processor -- start 2022-05-02T09:39:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.695+0000 7efbfd79d700 1 -- start start 2022-05-02T09:39:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 0x7efbf80936e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 0x7efbf80a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8139120 0x7efbf8148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a2460 con 0x7efbf8136100 2022-05-02T09:39:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a1f80 con 0x7efbf8065ad0 2022-05-02T09:39:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfd79d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8093250 con 0x7efbf8139120 2022-05-02T09:39:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbfcf9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8139120 0x7efbf8148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbf7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 0x7efbf80936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbf77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 0x7efbf80a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbf7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 0x7efbf80936e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.696+0000 7efbf7fff700 1 -- 172.21.15.50:0/2591763534 learned_addr learned my addr 172.21.15.50:0/2591763534 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 -- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8139120 msgr2=0x7efbf8148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8139120 0x7efbf8148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 -- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 msgr2=0x7efbf80936e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 0x7efbf80936e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 -- 172.21.15.50:0/2591763534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe800b180 con 0x7efbf8136100 2022-05-02T09:39:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf77fe700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 0x7efbf80a1a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efbec002f70 tx=0x7efbec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec016070 con 0x7efbf8136100 2022-05-02T09:39:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.697+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec00d8f0 con 0x7efbf8136100 2022-05-02T09:39:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.698+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbec00b180 con 0x7efbf8136100 2022-05-02T09:39:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.698+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec013de0 con 0x7efbf8136100 2022-05-02T09:39:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.698+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf8095d40 con 0x7efbf8136100 2022-05-02T09:39:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.699+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7efbec025030 con 0x7efbf8136100 2022-05-02T09:39:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.699+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80a2f80 con 0x7efbf8136100 2022-05-02T09:39:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.699+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efbec04b120 con 0x7efbf8136100 2022-05-02T09:39:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.702+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efbec01ffe0 con 0x7efbf8136100 2022-05-02T09:39:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.862+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efbf8057990 con 0x7efbf8136100 2022-05-02T09:39:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.863+0000 7efbf57fa700 1 -- 172.21.15.50:0/2591763534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+73 (secure 0 0 0) 0x7efbec023030 con 0x7efbf8136100 2022-05-02T09:39:31.876 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2022-05-02T09:39:31.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.864+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 >> v1:172.21.15.50:6800/30011 conn(0x7efbd8038940 legacy=0x7efbd803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.864+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 msgr2=0x7efbf80a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.864+0000 7efbfd79d700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 0x7efbf80a1a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efbec002f70 tx=0x7efbec014000).stop 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 shutdown_connections 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7efbf8139120 0x7efbf8148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efbf8065ad0 0x7efbf80936e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 --2- 172.21.15.50:0/2591763534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf8136100 0x7efbf80a1a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 >> 172.21.15.50:0/2591763534 conn(0x7efbf80a9030 msgr2=0x7efbf8133600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 shutdown_connections 2022-05-02T09:39:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:31.865+0000 7efbfd79d700 1 -- 172.21.15.50:0/2591763534 wait complete. 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:self.client.name = client.1 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-05-02T09:39:31.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-05-02T09:39:31.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-05-02T09:39:31.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2022-05-02T09:39:31.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:31.892 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2022-05-02T09:39:31.954 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-05-02T09:39:31.954 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-05-02T09:39:31.954 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:31.955 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42710sec preferred_lft 42710sec 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2022-05-02T09:39:31.956 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2022-05-02T09:39:31.957 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-05-02T09:39:31.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2022-05-02T09:39:31.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-05-02T09:39:31.959 DEBUG:teuthology.orchestra.run.smithi086:> ') 2022-05-02T09:39:32.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:32.279 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-05-02T09:39:32.425 INFO:teuthology.orchestra.run.smithi086.stdout:1 2022-05-02T09:39:32.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:32.470 DEBUG:teuthology.orchestra.run.smithi086:> route 2022-05-02T09:39:32.543 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2022-05-02T09:39:32.543 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-05-02T09:39:32.544 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-05-02T09:39:32.544 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-05-02T09:39:32.544 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-05-02T09:39:32.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:32.545 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2022-05-02T09:39:32.545 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2022-05-02T09:39:32.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-05-02T09:39:32.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-05-02T09:39:32.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-05-02T09:39:32.546 DEBUG:teuthology.orchestra.run.smithi086:> ') 2022-05-02T09:39:32.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:32.926 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2022-05-02T09:39:32.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:32.985 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2022-05-02T09:39:33.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:33.043 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2022-05-02T09:39:33.043 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2022-05-02T09:39:33.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2022-05-02T09:39:33.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2022-05-02T09:39:33.044 DEBUG:teuthology.orchestra.run.smithi086:> ') 2022-05-02T09:39:33.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2022-05-02T09:39:33.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2022-05-02T09:39:33.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2022-05-02T09:39:33.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2022-05-02T09:39:33.227 DEBUG:teuthology.orchestra.run.smithi086:> ') 2022-05-02T09:39:33.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:33.574 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2022-05-02T09:39:33.575 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2022-05-02T09:39:33.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2022-05-02T09:39:33.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2022-05-02T09:39:33.575 DEBUG:teuthology.orchestra.run.smithi086:> ') 2022-05-02T09:39:33.787 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-05-02T09:39:33.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-05-02T09:39:33.788 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:33.846 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2022-05-02T09:39:33.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-05-02T09:39:33.847 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:33.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2022-05-02T09:39:33.990 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-05-02T09:39:33.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-05-02T09:39:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-05-02T09:39:34.078 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-05-02T09:39:34.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:34.079 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2022-05-02T09:39:34.136 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-05-02T09:39:34.137 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2022-05-02T09:39:34.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2022-05-02T09:39:34.231 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-05-02T09:39:34.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-05-02T09:39:34.318 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-05-02T09:39:34.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-05-02T09:39:34.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:34.323 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2022-05-02T09:39:34.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:2022-05-02T09:39:34.373+0000 7ff7d9f2f200 -1 init, newargv = 0x55f71758eb90 newargc=9 2022-05-02T09:39:34.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:ceph-fuse[28263]: starting ceph client 2022-05-02T09:39:34.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:ceph-fuse[28263]: starting fuse 2022-05-02T09:39:35.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2022-05-02T09:39:35.578 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-05-02T09:39:35.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-05-02T09:39:35.663 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-05-02T09:39:35.667 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-05-02T09:39:35.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:35.667 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2022-05-02T09:39:35.724 INFO:teuthology.orchestra.run.smithi086.stdout:43 2022-05-02T09:39:35.725 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2022-05-02T09:39:35.725 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-05-02T09:39:35.725 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2022-05-02T09:39:35.725 DEBUG:teuthology.orchestra.run.smithi086:> import re 2022-05-02T09:39:35.725 DEBUG:teuthology.orchestra.run.smithi086:> import os 2022-05-02T09:39:35.725 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2022-05-02T09:39:35.726 DEBUG:teuthology.orchestra.run.smithi086:> 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2022-05-02T09:39:35.727 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2022-05-02T09:39:35.728 DEBUG:teuthology.orchestra.run.smithi086:> return f 2022-05-02T09:39:35.728 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-05-02T09:39:35.728 DEBUG:teuthology.orchestra.run.smithi086:> 2022-05-02T09:39:35.728 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.1")) 2022-05-02T09:39:35.728 DEBUG:teuthology.orchestra.run.smithi086:> ' 2022-05-02T09:39:35.893 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.1.28263.asok 2022-05-02T09:39:36.072 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.28263.asok 2022-05-02T09:39:36.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:36.073 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.28263.asok status 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "d46a73d6d0a67a79558054a3a5a72cb561724974", 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 15.2.16 (d46a73d6d0a67a79558054a3a5a72cb561724974) octopus (stable)", 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "1", 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2022-05-02T09:39:36.258 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "28263", 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4713, 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2022-05-02T09:39:36.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4713 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 2227349552 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2022-05-02T09:39:36.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 2227349552 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4713 172.21.15.86:0/2227349552", 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "172.21.15.86:0/2227349552", 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 10, 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 20, 2022-05-02T09:39:36.261 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2022-05-02T09:39:36.262 INFO:teuthology.orchestra.run.smithi086.stdout: "blacklisted": false, 2022-05-02T09:39:36.262 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2022-05-02T09:39:36.262 INFO:teuthology.orchestra.run.smithi086.stdout:} 2022-05-02T09:39:36.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:36.276 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2022-05-02T09:39:36.277 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:36.339 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2022-05-02T09:39:36.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:36.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:36.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-05-02T09:39:36.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:36.457 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2022-05-02T09:39:36.457 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:36.516 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2022-05-02T09:39:36.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:36.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:39:36.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2022-05-02T09:39:40.843 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:39:40.853 INFO:teuthology.task.print:**** done octopus client 2022-05-02T09:39:40.853 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:39:40.885 INFO:teuthology.task.print:**** done fsstress 2022-05-02T09:39:40.885 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2022-05-02T09:39:40.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 Processor -- start 2022-05-02T09:39:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 -- start start 2022-05-02T09:39:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 0x7f518805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5188139b00 0x7f518805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5188139010 con 0x7f518805cc50 2022-05-02T09:39:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51881392d0 con 0x7f5188139b00 2022-05-02T09:39:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f518d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51880a7c50 con 0x7f5188139720 2022-05-02T09:39:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f5187fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 0x7f518805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.159+0000 7f51877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5188139b00 0x7f518805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f518cb9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f518805cc50 0x7f518805fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52212/0 (socket says 172.21.15.50:52212) 2022-05-02T09:39:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f518cb9c700 1 -- 172.21.15.50:0/666311088 learned_addr learned my addr 172.21.15.50:0/666311088 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:41.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f51877fe700 1 -- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 msgr2=0x7f518805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f51877fe700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 0x7f518805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f51877fe700 1 -- 172.21.15.50:0/666311088 >> v1:172.21.15.50:6789/0 conn(0x7f518805cc50 legacy=0x7f518805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f51877fe700 1 -- 172.21.15.50:0/666311088 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880a95d0 con 0x7f5188139b00 2022-05-02T09:39:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f5187fff700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 0x7f518805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.160+0000 7f51877fe700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139b00 0x7f518805d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f517c002f70 tx=0x7f517c006df0).ready entity=mon.0 client_cookie=b018e391a3a7fe61 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f5186ffd700 1 -- 172.21.15.50:0/666311088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c00d570 con 0x7f5188139b00 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f5186ffd700 1 -- 172.21.15.50:0/666311088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c000e90 con 0x7f5188139b00 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f5186ffd700 1 -- 172.21.15.50:0/666311088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c00d8c0 con 0x7f5188139b00 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 -- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139b00 msgr2=0x7f518805d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139b00 0x7f518805d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f517c002f70 tx=0x7f517c006df0).stop 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 -- 172.21.15.50:0/666311088 shutdown_connections 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139720 0x7f518805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 --2- 172.21.15.50:0/666311088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139b00 0x7f518805d7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 -- 172.21.15.50:0/666311088 >> 172.21.15.50:0/666311088 conn(0x7f51880669d0 msgr2=0x7f51880a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 -- 172.21.15.50:0/666311088 shutdown_connections 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.161+0000 7f518d39d700 1 -- 172.21.15.50:0/666311088 wait complete. 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 Processor -- start 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 -- start start 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 0x7f51881457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139b00 0x7f5188149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51880a19b0 con 0x7f5188139720 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5188146180 con 0x7f518805cc50 2022-05-02T09:39:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.163+0000 7f518d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5188132340 con 0x7f5188139b00 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f51877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 0x7f51881457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f51877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35794/0 (socket says 172.21.15.50:35794) 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f51877fe700 1 -- 172.21.15.50:0/1614668542 learned_addr learned my addr 172.21.15.50:0/1614668542 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f518cb9c700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139b00 0x7f5188149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 -- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139b00 msgr2=0x7f5188149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139b00 0x7f5188149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 -- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 msgr2=0x7f5188148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f5187fff700 1 -- 172.21.15.50:0/1614668542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517800b180 con 0x7f518805cc50 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.164+0000 7f51877fe700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f5187fff700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 0x7f51881457b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f517800c000 tx=0x7f5178006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178010780 con 0x7f518805cc50 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51780108e0 con 0x7f518805cc50 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178010c40 con 0x7f518805cc50 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c00b180 con 0x7f518805cc50 2022-05-02T09:39:41.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.165+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51880a2530 con 0x7f518805cc50 2022-05-02T09:39:41.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.166+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f517801c460 con 0x7f518805cc50 2022-05-02T09:39:41.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.167+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5188057990 con 0x7f518805cc50 2022-05-02T09:39:41.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.167+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f517804a700 con 0x7f518805cc50 2022-05-02T09:39:41.179 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.170+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5178033270 con 0x7f518805cc50 2022-05-02T09:39:41.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.295+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5188061b40 con 0x7f518805cc50 2022-05-02T09:39:41.300 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.296+0000 7f51857fa700 1 -- 172.21.15.50:0/1614668542 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+10538 (secure 0 0 0) 0x7f5178032e60 con 0x7f518805cc50 2022-05-02T09:39:41.300 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:41.300 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:27.562783+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:41.301 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 >> v1:172.21.15.50:6800/30011 conn(0x7f5168038a00 legacy=0x7f516803aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 msgr2=0x7f51881457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 0x7f51881457b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f517800c000 tx=0x7f5178006df0).stop 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 shutdown_connections 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f5188139b00 0x7f5188149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f518805cc50 0x7f51881457b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 --2- 172.21.15.50:0/1614668542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5188139720 0x7f5188148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 >> 172.21.15.50:0/1614668542 conn(0x7f51880669d0 msgr2=0x7f518805fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 shutdown_connections 2022-05-02T09:39:41.302 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.298+0000 7f518d39d700 1 -- 172.21.15.50:0/1614668542 wait complete. 2022-05-02T09:39:41.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-05-02T09:39:08.938842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-05-02T09:39:10.323546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-05-02T09:39:41.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-05-02T09:39:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.531+0000 7f0d6ad9d700 1 Processor -- start 2022-05-02T09:39:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.531+0000 7f0d6ad9d700 1 -- start start 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 0x7f0d6405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6ad9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 0x7f0d6405d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6ad9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64139010 con 0x7f0d6405cc50 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6ad9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d641392d0 con 0x7f0d64139720 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6ad9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640a7c50 con 0x7f0d64139b00 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6959a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 0x7f0d6405d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d6a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0d6405cc50 0x7f0d6405fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52214/0 (socket says 172.21.15.50:52214) 2022-05-02T09:39:41.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6a59c700 1 -- 172.21.15.50:0/3448121211 learned_addr learned my addr 172.21.15.50:0/3448121211 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:41.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.532+0000 7f0d69d9b700 1 --2- 172.21.15.50:0/3448121211 >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 0x7f0d6405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6959a700 1 -- 172.21.15.50:0/3448121211 >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 msgr2=0x7f0d6405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6959a700 1 --2- 172.21.15.50:0/3448121211 >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 0x7f0d6405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6959a700 1 -- 172.21.15.50:0/3448121211 >> v1:172.21.15.50:6789/0 conn(0x7f0d6405cc50 legacy=0x7f0d6405fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6959a700 1 -- 172.21.15.50:0/3448121211 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640a95d0 con 0x7f0d64139b00 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d69d9b700 1 --2- 172.21.15.50:0/3448121211 >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 0x7f0d6405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.533+0000 7f0d6959a700 1 --2- 172.21.15.50:0/3448121211 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 0x7f0d6405d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0d54002f70 tx=0x7f0d54006df0).ready entity=mon.2 client_cookie=98b17ea5f71ff627 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d68d99700 1 -- 172.21.15.50:0/3448121211 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5400d570 con 0x7f0d64139b00 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d68d99700 1 -- 172.21.15.50:0/3448121211 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54000e90 con 0x7f0d64139b00 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d68d99700 1 -- 172.21.15.50:0/3448121211 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5400d8c0 con 0x7f0d64139b00 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/3448121211 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 msgr2=0x7f0d6405d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/3448121211 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 0x7f0d6405d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0d54002f70 tx=0x7f0d54006df0).stop 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/3448121211 shutdown_connections 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/3448121211 >> v2:172.21.15.50:3300/0 conn(0x7f0d64139720 0x7f0d6405b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/3448121211 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139b00 0x7f0d6405d7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/3448121211 >> 172.21.15.50:0/3448121211 conn(0x7f0d640669d0 msgr2=0x7f0d640a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/3448121211 shutdown_connections 2022-05-02T09:39:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.534+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/3448121211 wait complete. 2022-05-02T09:39:41.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.535+0000 7f0d6ad9d700 1 Processor -- start 2022-05-02T09:39:41.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 -- start start 2022-05-02T09:39:41.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139720 0x7f0d64132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d64139b00 0x7f0d64145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640a54f0 con 0x7f0d6405cc50 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640a2c20 con 0x7f0d64139b00 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.536+0000 7f0d6ad9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640a3140 con 0x7f0d64139720 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35798/0 (socket says 172.21.15.50:35798) 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 -- 172.21.15.50:0/2874121646 learned_addr learned my addr 172.21.15.50:0/2874121646 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:41.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d6959a700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139720 0x7f0d64132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d6a59c700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d64139b00 0x7f0d64145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 -- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139720 msgr2=0x7f0d64132990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139720 0x7f0d64132990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 -- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d64139b00 msgr2=0x7f0d64145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d64139b00 0x7f0d64145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.537+0000 7f0d69d9b700 1 -- 172.21.15.50:0/2874121646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6000b180 con 0x7f0d6405cc50 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d69d9b700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0d6000c000 tx=0x7f0d60006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6000c7e0 con 0x7f0d6405cc50 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000c940 con 0x7f0d6405cc50 2022-05-02T09:39:41.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5400b180 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6000cca0 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.538+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640a66c0 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.539+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0d6001c460 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.539+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d64133040 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.540+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0d6004a840 con 0x7f0d6405cc50 2022-05-02T09:39:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.544+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0d64133040 con 0x7f0d6405cc50 2022-05-02T09:39:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.671+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0d64133040 con 0x7f0d6405cc50 2022-05-02T09:39:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.672+0000 7f0d52ffd700 1 -- 172.21.15.50:0/2874121646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v20) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0d64133040 con 0x7f0d6405cc50 2022-05-02T09:39:41.675 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:39:41.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 >> v1:172.21.15.50:6800/30011 conn(0x7f0d44038940 legacy=0x7f0d4403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 msgr2=0x7f0d640a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0d6000c000 tx=0x7f0d60006df0).stop 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 shutdown_connections 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d64139b00 0x7f0d64145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6405cc50 0x7f0d640a5000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 --2- 172.21.15.50:0/2874121646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0d64139720 0x7f0d64132990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.673+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 >> 172.21.15.50:0/2874121646 conn(0x7f0d640669d0 msgr2=0x7f0d640ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.674+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 shutdown_connections 2022-05-02T09:39:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.674+0000 7f0d6ad9d700 1 -- 172.21.15.50:0/2874121646 wait complete. 2022-05-02T09:39:41.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:39:41.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.905+0000 7f0e729ff700 1 Processor -- start 2022-05-02T09:39:41.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.906+0000 7f0e729ff700 1 -- start start 2022-05-02T09:39:41.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 0x7f0e6c135ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 0x7f0e6c1392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e6c133490 0x7f0e6c1397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c05c2e0 con 0x7f0e6c133490 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c061290 con 0x7f0e6c1330b0 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e729ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c05d890 con 0x7f0e6c1361d0 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e70f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e6c133490 0x7f0e6c1397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e6bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 0x7f0e6c135ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 0x7f0e6c1392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 0x7f0e6c1392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49692/0 (socket says 172.21.15.50:49692) 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e6bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 0x7f0e6c135ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50366/0 (socket says 172.21.15.50:50366) 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e6bfff700 1 -- 172.21.15.50:0/660595784 learned_addr learned my addr 172.21.15.50:0/660595784 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.907+0000 7f0e70f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e6c133490 0x7f0e6c1397a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35800/0 (socket says 172.21.15.50:35800) 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 -- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 msgr2=0x7f0e6c1392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 0x7f0e6c1392b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 -- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 msgr2=0x7f0e6c135ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 0x7f0e6c135ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 -- 172.21.15.50:0/660595784 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0a7540 con 0x7f0e6c133490 2022-05-02T09:39:41.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e70f9c700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c133490 0x7f0e6c1397a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0e640032f0 tx=0x7f0e640091d0).ready entity=mon.0 client_cookie=1952f97247a20e3a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e6affd700 1 -- 172.21.15.50:0/660595784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e6400b5a0 con 0x7f0e6c133490 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e6affd700 1 -- 172.21.15.50:0/660595784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6400b700 con 0x7f0e6c133490 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.908+0000 7f0e6affd700 1 -- 172.21.15.50:0/660595784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e6400b870 con 0x7f0e6c133490 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 -- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c133490 msgr2=0x7f0e6c1397a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c133490 0x7f0e6c1397a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0e640032f0 tx=0x7f0e640091d0).stop 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 -- 172.21.15.50:0/660595784 shutdown_connections 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c133490 0x7f0e6c1397a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1330b0 0x7f0e6c135ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 --2- 172.21.15.50:0/660595784 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c1361d0 0x7f0e6c1392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 -- 172.21.15.50:0/660595784 >> 172.21.15.50:0/660595784 conn(0x7f0e6c0a8d70 msgr2=0x7f0e6c0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:41.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 -- 172.21.15.50:0/660595784 shutdown_connections 2022-05-02T09:39:41.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.909+0000 7f0e729ff700 1 -- 172.21.15.50:0/660595784 wait complete. 2022-05-02T09:39:41.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.910+0000 7f0e729ff700 1 Processor -- start 2022-05-02T09:39:41.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 -- start start 2022-05-02T09:39:41.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c133490 0x7f0e6c12f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 0x7f0e6c12f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c145bc0 con 0x7f0e6c1330b0 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0a5730 con 0x7f0e6c1361d0 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.911+0000 7f0e729ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c145dc0 con 0x7f0e6c133490 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e70f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 0x7f0e6c12f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35802/0 (socket says 172.21.15.50:35802) 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 -- 172.21.15.50:0/1356191912 learned_addr learned my addr 172.21.15.50:0/1356191912 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6b7fe700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c133490 0x7f0e6c12f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 -- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c133490 msgr2=0x7f0e6c12f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c133490 0x7f0e6c12f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 -- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 msgr2=0x7f0e6c12f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 0x7f0e6c12f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e6bfff700 1 -- 172.21.15.50:0/1356191912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64009470 con 0x7f0e6c1330b0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.912+0000 7f0e70f9c700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 0x7f0e6c12f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0e5c00c000 tx=0x7f0e5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5c013610 con 0x7f0e6c1330b0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c013770 con 0x7f0e6c1330b0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5c013ad0 con 0x7f0e6c1330b0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c146080 con 0x7f0e6c1330b0 2022-05-02T09:39:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.913+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c0a6510 con 0x7f0e6c1330b0 2022-05-02T09:39:41.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.914+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f0e5c013c30 con 0x7f0e6c1330b0 2022-05-02T09:39:41.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.914+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c130e80 con 0x7f0e6c1330b0 2022-05-02T09:39:41.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.915+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0e5c04a150 con 0x7f0e6c1330b0 2022-05-02T09:39:41.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:41.918+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0e5c032bb0 con 0x7f0e6c1330b0 2022-05-02T09:39:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.046+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e6c136980 con 0x7f0e6c1330b0 2022-05-02T09:39:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.047+0000 7f0e697fa700 1 -- 172.21.15.50:0/1356191912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e5c0327a0 con 0x7f0e6c1330b0 2022-05-02T09:39:42.050 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 >> v1:172.21.15.50:6800/30011 conn(0x7f0e4c038a90 legacy=0x7f0e4c03af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 msgr2=0x7f0e6c1456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0e5c00c000 tx=0x7f0e5c008040).stop 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 shutdown_connections 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0e6c1361d0 0x7f0e6c12f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c1330b0 0x7f0e6c1456d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 --2- 172.21.15.50:0/1356191912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0e6c133490 0x7f0e6c12f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 >> 172.21.15.50:0/1356191912 conn(0x7f0e6c0a8d70 msgr2=0x7f0e6c131970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:42.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 shutdown_connections 2022-05-02T09:39:42.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.049+0000 7f0e729ff700 1 -- 172.21.15.50:0/1356191912 wait complete. 2022-05-02T09:39:42.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-05-02T09:39:42.282 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.280+0000 7f4766b9d700 1 Processor -- start 2022-05-02T09:39:42.283 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.280+0000 7f4766b9d700 1 -- start start 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.281+0000 7f4766b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 0x7f476005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.281+0000 7f4766b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 0x7f47601402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.281+0000 7f4766b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476005d360 con 0x7f4760139720 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.281+0000 7f4766b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4760139010 con 0x7f476005d7d0 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.281+0000 7f4766b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47601392d0 con 0x7f4760139b00 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 0x7f476005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f4765b9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4760139720 0x7f476005cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52216/0 (socket says 172.21.15.50:52216) 2022-05-02T09:39:42.285 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f4765b9b700 1 -- 172.21.15.50:0/1842419428 learned_addr learned my addr 172.21.15.50:0/1842419428 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:42.285 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476639c700 1 --2- 172.21.15.50:0/1842419428 >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 0x7f47601402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 -- 172.21.15.50:0/1842419428 >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 msgr2=0x7f47601402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f4764b99700 1 -- 172.21.15.50:0/1842419428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706720731 0 0) 0x7f476005d360 con 0x7f4760139720 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 --2- 172.21.15.50:0/1842419428 >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 0x7f47601402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 -- 172.21.15.50:0/1842419428 >> v1:172.21.15.50:6789/0 conn(0x7f4760139720 legacy=0x7f476005cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 -- 172.21.15.50:0/1842419428 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600a7c50 con 0x7f4760139b00 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476639c700 1 --2- 172.21.15.50:0/1842419428 >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 0x7f47601402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.282+0000 7f476539a700 1 --2- 172.21.15.50:0/1842419428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 0x7f476005b8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4750002f70 tx=0x7f4750006df0).ready entity=mon.1 client_cookie=e60ffe9fafeef6ba server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4764b99700 1 -- 172.21.15.50:0/1842419428 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475000d570 con 0x7f4760139b00 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4764b99700 1 -- 172.21.15.50:0/1842419428 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750000e90 con 0x7f4760139b00 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4764b99700 1 -- 172.21.15.50:0/1842419428 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475000d8c0 con 0x7f4760139b00 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 -- 172.21.15.50:0/1842419428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 msgr2=0x7f476005b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 --2- 172.21.15.50:0/1842419428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 0x7f476005b8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4750002f70 tx=0x7f4750006df0).stop 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 -- 172.21.15.50:0/1842419428 shutdown_connections 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 --2- 172.21.15.50:0/1842419428 >> v2:172.21.15.50:3300/0 conn(0x7f476005d7d0 0x7f47601402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 --2- 172.21.15.50:0/1842419428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4760139b00 0x7f476005b8a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.283+0000 7f4766b9d700 1 -- 172.21.15.50:0/1842419428 >> 172.21.15.50:0/1842419428 conn(0x7f47600669d0 msgr2=0x7f47600a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.284+0000 7f4766b9d700 1 -- 172.21.15.50:0/1842419428 shutdown_connections 2022-05-02T09:39:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.284+0000 7f4766b9d700 1 -- 172.21.15.50:0/1842419428 wait complete. 2022-05-02T09:39:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.285+0000 7f4766b9d700 1 Processor -- start 2022-05-02T09:39:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.285+0000 7f4766b9d700 1 -- start start 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f476005d7d0 0x7f4760115680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 0x7f4760131b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760114550 con 0x7f4760139720 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47600a5b70 con 0x7f476005d7d0 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4766b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47600a5e30 con 0x7f4760139b00 2022-05-02T09:39:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f476539a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f4765b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f476005d7d0 0x7f4760115680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f476539a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35806/0 (socket says 172.21.15.50:35806) 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f476539a700 1 -- 172.21.15.50:0/3724385646 learned_addr learned my addr 172.21.15.50:0/3724385646 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.286+0000 7f476639c700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 0x7f4760131b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 -- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f476005d7d0 msgr2=0x7f4760115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f476005d7d0 0x7f4760115680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 -- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 msgr2=0x7f4760131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 -- 172.21.15.50:0/3724385646 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009470 con 0x7f4760139b00 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476539a700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f476639c700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 0x7f4760131b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f475800c000 tx=0x7f47580091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475800c610 con 0x7f4760139b00 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800c770 con 0x7f4760139b00 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475800cad0 con 0x7f4760139b00 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475000b180 con 0x7f4760139b00 2022-05-02T09:39:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.287+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4760113c70 con 0x7f4760139b00 2022-05-02T09:39:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.288+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47600a3160 con 0x7f4760139b00 2022-05-02T09:39:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.289+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f4758022070 con 0x7f4760139b00 2022-05-02T09:39:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.289+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f475804a9f0 con 0x7f4760139b00 2022-05-02T09:39:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.292+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4758033450 con 0x7f4760139b00 2022-05-02T09:39:42.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.415+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4760057990 con 0x7f4760139b00 2022-05-02T09:39:42.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.416+0000 7f474effd700 1 -- 172.21.15.50:0/3724385646 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4758016020 con 0x7f4760139b00 2022-05-02T09:39:42.418 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2022-05-02T09:39:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 >> v1:172.21.15.50:6800/30011 conn(0x7f4740038940 legacy=0x7f474003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 msgr2=0x7f4760131b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 0x7f4760131b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f475800c000 tx=0x7f47580091d0).stop 2022-05-02T09:39:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 shutdown_connections 2022-05-02T09:39:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4760139b00 0x7f4760131b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f476005d7d0 0x7f4760115680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 --2- 172.21.15.50:0/3724385646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4760139720 0x7f4760131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 >> 172.21.15.50:0/3724385646 conn(0x7f47600669d0 msgr2=0x7f476005cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 shutdown_connections 2022-05-02T09:39:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.417+0000 7f4766b9d700 1 -- 172.21.15.50:0/3724385646 wait complete. 2022-05-02T09:39:42.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-05-02T09:39:42.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.652+0000 7f4e01f9d700 1 Processor -- start 2022-05-02T09:39:42.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.652+0000 7f4e01f9d700 1 -- start start 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.653+0000 7f4e01f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 0x7f4dfc05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.653+0000 7f4e01f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.653+0000 7f4e01f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc05d360 con 0x7f4dfc139720 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.653+0000 7f4e01f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc139010 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.653+0000 7f4e01f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc1392d0 con 0x7f4dfc139b00 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4e00f9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4dfc139720 0x7f4dfc05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52220/0 (socket says 172.21.15.50:52220) 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4e00f9b700 1 -- 172.21.15.50:0/3986217992 learned_addr learned my addr 172.21.15.50:0/3986217992 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 0x7f4dfc05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4e0179c700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 -- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 msgr2=0x7f4dfc1402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc1402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 -- 172.21.15.50:0/3986217992 >> v1:172.21.15.50:6789/0 conn(0x7f4dfc139720 legacy=0x7f4dfc05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 -- 172.21.15.50:0/3986217992 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0a7c50 con 0x7f4dfc139b00 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfb7fe700 1 -- 172.21.15.50:0/3986217992 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441794955 0 0) 0x7f4dfc05d360 con 0x7f4dfc139720 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4e0179c700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.654+0000 7f4dfbfff700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 0x7f4dfc05b8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4de8002f70 tx=0x7f4de8006df0).ready entity=mon.2 client_cookie=406c2e297ae59b87 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4dfb7fe700 1 -- 172.21.15.50:0/3986217992 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de800d570 con 0x7f4dfc139b00 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4dfb7fe700 1 -- 172.21.15.50:0/3986217992 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8000e90 con 0x7f4dfc139b00 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4dfb7fe700 1 -- 172.21.15.50:0/3986217992 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de800d8c0 con 0x7f4dfc139b00 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 -- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 msgr2=0x7f4dfc05b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 0x7f4dfc05b8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4de8002f70 tx=0x7f4de8006df0).stop 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 -- 172.21.15.50:0/3986217992 shutdown_connections 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/3986217992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139b00 0x7f4dfc05b8a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 -- 172.21.15.50:0/3986217992 >> 172.21.15.50:0/3986217992 conn(0x7f4dfc0669d0 msgr2=0x7f4dfc0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.655+0000 7f4e01f9d700 1 -- 172.21.15.50:0/3986217992 shutdown_connections 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.656+0000 7f4e01f9d700 1 -- 172.21.15.50:0/3986217992 wait complete. 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.657+0000 7f4e01f9d700 1 Processor -- start 2022-05-02T09:39:42.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.657+0000 7f4e01f9d700 1 -- start start 2022-05-02T09:39:42.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 0x7f4dfc0a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dfc139b00 0x7f4dfc1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0a1b20 con 0x7f4dfc139b00 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0a0740 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e01f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0a6600 con 0x7f4dfc139720 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e00f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 0x7f4dfc0a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e0179c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dfc139b00 0x7f4dfc1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e00f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50376/0 (socket says 172.21.15.50:50376) 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e00f9b700 1 -- 172.21.15.50:0/348702156 learned_addr learned my addr 172.21.15.50:0/348702156 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e00f9b700 1 -- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 msgr2=0x7f4dfc0a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.658+0000 7f4e00f9b700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 0x7f4dfc0a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e00f9b700 1 -- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dfc139b00 msgr2=0x7f4dfc1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e00f9b700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dfc139b00 0x7f4dfc1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e00f9b700 1 -- 172.21.15.50:0/348702156 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009470 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4dfbfff700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 0x7f4dfc0a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e00f9b700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4df0000bc0 tx=0x7f4df0007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df00070d0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0007230 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de800b180 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df0005610 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.659+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc149890 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.660+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc149ae0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.660+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f4df0010070 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.661+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4df0049ac0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.666 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.664+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4dfc149ae0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.790+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4dfc149ae0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.794 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.791+0000 7f4df9ffb700 1 -- 172.21.15.50:0/348702156 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4dfc149ae0 con 0x7f4dfc05d7d0 2022-05-02T09:39:42.794 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2022-05-02T09:39:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 >> v1:172.21.15.50:6800/30011 conn(0x7f4ddc0389d0 legacy=0x7f4ddc03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 msgr2=0x7f4dfc148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4df0000bc0 tx=0x7f4df0007a60).stop 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 shutdown_connections 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dfc139b00 0x7f4dfc1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4dfc05d7d0 0x7f4dfc148bc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 --2- 172.21.15.50:0/348702156 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4dfc139720 0x7f4dfc0a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 >> 172.21.15.50:0/348702156 conn(0x7f4dfc0669d0 msgr2=0x7f4dfc1387d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 shutdown_connections 2022-05-02T09:39:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:42.793+0000 7f4e01f9d700 1 -- 172.21.15.50:0/348702156 wait complete. 2022-05-02T09:39:42.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:43.027 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.025+0000 7f979d79d700 1 Processor -- start 2022-05-02T09:39:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.025+0000 7f979d79d700 1 -- start start 2022-05-02T09:39:43.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.026+0000 7f979d79d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139720 0x7f979805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.026+0000 7f979d79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979805d7d0 0x7f97981402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.026+0000 7f979d79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979805d360 con 0x7f9798139b00 2022-05-02T09:39:43.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.026+0000 7f979d79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798139010 con 0x7f979805d7d0 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.026+0000 7f979d79d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97981392d0 con 0x7f9798139720 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f979cf9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979805d7d0 0x7f97981402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f9797fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139720 0x7f979805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f97977fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9798139b00 0x7f979805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52222/0 (socket says 172.21.15.50:52222) 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f97977fe700 1 -- 172.21.15.50:0/411460413 learned_addr learned my addr 172.21.15.50:0/411460413 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f979cf9c700 1 -- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139720 msgr2=0x7f979805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f979cf9c700 1 --2- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139720 0x7f979805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f979cf9c700 1 -- 172.21.15.50:0/411460413 >> v1:172.21.15.50:6789/0 conn(0x7f9798139b00 legacy=0x7f979805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.027+0000 7f979cf9c700 1 -- 172.21.15.50:0/411460413 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980a7c50 con 0x7f979805d7d0 2022-05-02T09:39:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979cf9c700 1 --2- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979805d7d0 0x7f97981402a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f97900032f0 tx=0x7f97900091d0).ready entity=mon.0 client_cookie=81745956f55b66d5 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f9796ffd700 1 -- 172.21.15.50:0/411460413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f979000b6c0 con 0x7f979805d7d0 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f9796ffd700 1 -- 172.21.15.50:0/411460413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000b820 con 0x7f979805d7d0 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f9796ffd700 1 -- 172.21.15.50:0/411460413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f979000b990 con 0x7f979805d7d0 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 -- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979805d7d0 msgr2=0x7f97981402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 --2- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979805d7d0 0x7f97981402a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f97900032f0 tx=0x7f97900091d0).stop 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 -- 172.21.15.50:0/411460413 shutdown_connections 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 --2- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979805d7d0 0x7f97981402a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 --2- 172.21.15.50:0/411460413 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139720 0x7f979805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.028+0000 7f979d79d700 1 -- 172.21.15.50:0/411460413 >> 172.21.15.50:0/411460413 conn(0x7f97980669d0 msgr2=0x7f97980a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:43.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.029+0000 7f979d79d700 1 -- 172.21.15.50:0/411460413 shutdown_connections 2022-05-02T09:39:43.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.029+0000 7f979d79d700 1 -- 172.21.15.50:0/411460413 wait complete. 2022-05-02T09:39:43.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.030+0000 7f979d79d700 1 Processor -- start 2022-05-02T09:39:43.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.030+0000 7f979d79d700 1 -- start start 2022-05-02T09:39:43.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9798139720 0x7f979812bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139b00 0x7f979812c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980a06d0 con 0x7f9798139720 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980a1ab0 con 0x7f979805d7d0 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979d79d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97980a2710 con 0x7f9798139b00 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f9797fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f9797fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50378/0 (socket says 172.21.15.50:50378) 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f9797fff700 1 -- 172.21.15.50:0/3447696846 learned_addr learned my addr 172.21.15.50:0/3447696846 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f979cf9c700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139b00 0x7f979812c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.031+0000 7f97977fe700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9798139720 0x7f979812bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 -- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139b00 msgr2=0x7f979812c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139b00 0x7f979812c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 -- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9798139720 msgr2=0x7f979812bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9798139720 0x7f979812bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 -- 172.21.15.50:0/3447696846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009470 con 0x7f979805d7d0 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f9797fff700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f978800c000 tx=0x7f9788006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9788010780 con 0x7f979805d7d0 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880108e0 con 0x7f979805d7d0 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798132a40 con 0x7f979805d7d0 2022-05-02T09:39:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.032+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9788010c40 con 0x7f979805d7d0 2022-05-02T09:39:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.033+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798132f50 con 0x7f979805d7d0 2022-05-02T09:39:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.034+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f978801c460 con 0x7f979805d7d0 2022-05-02T09:39:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.034+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798057990 con 0x7f979805d7d0 2022-05-02T09:39:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.034+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f978804a7a0 con 0x7f979805d7d0 2022-05-02T09:39:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.037+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9788033200 con 0x7f979805d7d0 2022-05-02T09:39:43.197 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.194+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9798061b40 con 0x7f979805d7d0 2022-05-02T09:39:43.197 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.195+0000 7f97957fa700 1 -- 172.21.15.50:0/3447696846 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2322 (secure 0 0 0) 0x7f9788032df0 con 0x7f979805d7d0 2022-05-02T09:39:43.198 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:15.328375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:43.199 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 >> v1:172.21.15.50:6800/30011 conn(0x7f9778038a00 legacy=0x7f977803aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 msgr2=0x7f97980a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f978800c000 tx=0x7f9788006df0).stop 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 shutdown_connections 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9798139b00 0x7f979812c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f979805d7d0 0x7f97980a2220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 --2- 172.21.15.50:0/3447696846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9798139720 0x7f979812bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 >> 172.21.15.50:0/3447696846 conn(0x7f97980669d0 msgr2=0x7f97981339f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 shutdown_connections 2022-05-02T09:39:43.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.197+0000 7f979d79d700 1 -- 172.21.15.50:0/3447696846 wait complete. 2022-05-02T09:39:43.201 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2022-05-02T09:39:43.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:39:43.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.431+0000 7fa66199d700 1 Processor -- start 2022-05-02T09:39:43.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.431+0000 7fa66199d700 1 -- start start 2022-05-02T09:39:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.432+0000 7fa66199d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa65c139720 0x7fa65c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.432+0000 7fa66199d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 0x7fa65c05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.432+0000 7fa66199d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c139010 con 0x7fa65c05cc50 2022-05-02T09:39:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.432+0000 7fa66199d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c1392d0 con 0x7fa65c139720 2022-05-02T09:39:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.432+0000 7fa66199d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a7c50 con 0x7fa65c139b00 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa65c139720 0x7fa65c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 0x7fa65c05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 0x7fa65c05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50380/0 (socket says 172.21.15.50:50380) 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa65bfff700 1 -- 172.21.15.50:0/773507336 learned_addr learned my addr 172.21.15.50:0/773507336 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa65c139720 0x7fa65c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35814/0 (socket says 172.21.15.50:35814) 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66119c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa65c05cc50 0x7fa65c05fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52224/0 (socket says 172.21.15.50:52224) 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 -- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 msgr2=0x7fa65c05d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 --2- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 0x7fa65c05d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 -- 172.21.15.50:0/773507336 >> v1:172.21.15.50:6789/0 conn(0x7fa65c05cc50 legacy=0x7fa65c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa66099b700 1 -- 172.21.15.50:0/773507336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0a95d0 con 0x7fa65c139720 2022-05-02T09:39:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.433+0000 7fa65b7fe700 1 -- 172.21.15.50:0/773507336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355849393 0 0) 0x7fa65c139010 con 0x7fa65c05cc50 2022-05-02T09:39:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa66099b700 1 --2- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c05b8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa650002f70 tx=0x7fa650006df0).ready entity=mon.0 client_cookie=5b19a3797411d1aa server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa65b7fe700 1 -- 172.21.15.50:0/773507336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65000d570 con 0x7fa65c139720 2022-05-02T09:39:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa65b7fe700 1 -- 172.21.15.50:0/773507336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650000e90 con 0x7fa65c139720 2022-05-02T09:39:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa65b7fe700 1 -- 172.21.15.50:0/773507336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65000d8c0 con 0x7fa65c139720 2022-05-02T09:39:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa66199d700 1 -- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 msgr2=0x7fa65c05b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.434+0000 7fa66199d700 1 --2- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c05b8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa650002f70 tx=0x7fa650006df0).stop 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 -- 172.21.15.50:0/773507336 shutdown_connections 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 --2- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c05b8a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 --2- 172.21.15.50:0/773507336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c139b00 0x7fa65c05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 -- 172.21.15.50:0/773507336 >> 172.21.15.50:0/773507336 conn(0x7fa65c0669d0 msgr2=0x7fa65c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 -- 172.21.15.50:0/773507336 shutdown_connections 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.435+0000 7fa66199d700 1 -- 172.21.15.50:0/773507336 wait complete. 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.436+0000 7fa66199d700 1 Processor -- start 2022-05-02T09:39:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.436+0000 7fa66199d700 1 -- start start 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c05cc50 0x7fa65c0a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 0x7fa65c12de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a2ed0 con 0x7fa65c139720 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a3190 con 0x7fa65c05cc50 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66199d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a2350 con 0x7fa65c139b00 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66119c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 0x7fa65c12de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa66099b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c05cc50 0x7fa65c0a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35816/0 (socket says 172.21.15.50:35816) 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.437+0000 7fa65bfff700 1 -- 172.21.15.50:0/2181054486 learned_addr learned my addr 172.21.15.50:0/2181054486 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 -- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c05cc50 msgr2=0x7fa65c0a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c05cc50 0x7fa65c0a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 -- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 msgr2=0x7fa65c0a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 -- 172.21.15.50:0/2181054486 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65000b180 con 0x7fa65c139b00 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa65bfff700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66119c700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 0x7fa65c12de10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa654001250 tx=0x7fa654007d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa654005ae0 con 0x7fa65c139b00 2022-05-02T09:39:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654005c40 con 0x7fa65c139b00 2022-05-02T09:39:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6540070d0 con 0x7fa65c139b00 2022-05-02T09:39:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.438+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c132940 con 0x7fa65c139b00 2022-05-02T09:39:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.439+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c132670 con 0x7fa65c139b00 2022-05-02T09:39:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.440+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fa654010070 con 0x7fa65c139b00 2022-05-02T09:39:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.440+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c0a2570 con 0x7fa65c139b00 2022-05-02T09:39:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.440+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa654049c40 con 0x7fa65c139b00 2022-05-02T09:39:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.443+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa65402ecb0 con 0x7fa65c139b00 2022-05-02T09:39:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.568+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa65c057990 con 0x7fa65c139b00 2022-05-02T09:39:43.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.569+0000 7fa659ffb700 1 -- 172.21.15.50:0/2181054486 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+10538 (secure 0 0 0) 0x7fa654024940 con 0x7fa65c139b00 2022-05-02T09:39:43.571 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:43.571 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:27.562783+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-05-02T09:39:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.570+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 >> v1:172.21.15.50:6800/30011 conn(0x7fa63c038a60 legacy=0x7fa63c03af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.570+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 msgr2=0x7fa65c12de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.570+0000 7fa66199d700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 0x7fa65c12de10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa654001250 tx=0x7fa654007d00).stop 2022-05-02T09:39:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 shutdown_connections 2022-05-02T09:39:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa65c139b00 0x7fa65c12de10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa65c05cc50 0x7fa65c0a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 --2- 172.21.15.50:0/2181054486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c139720 0x7fa65c0a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 >> 172.21.15.50:0/2181054486 conn(0x7fa65c0669d0 msgr2=0x7fa65c0ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:43.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 shutdown_connections 2022-05-02T09:39:43.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.571+0000 7fa66199d700 1 -- 172.21.15.50:0/2181054486 wait complete. 2022-05-02T09:39:43.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-05-02T09:39:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.804+0000 7fed9e39d700 1 Processor -- start 2022-05-02T09:39:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.804+0000 7fed9e39d700 1 -- start start 2022-05-02T09:39:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.805+0000 7fed9e39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 0x7fed9805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.805+0000 7fed9e39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 0x7fed981402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9e39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9805d360 con 0x7fed98139b00 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9e39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed98139010 con 0x7fed98139720 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9e39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed981392d0 con 0x7fed9805d7d0 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9d39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 0x7fed9805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9db9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 0x7fed981402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9cb9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed98139b00 0x7fed9805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52226/0 (socket says 172.21.15.50:52226) 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed9cb9a700 1 -- 172.21.15.50:0/213285285 learned_addr learned my addr 172.21.15.50:0/213285285 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.806+0000 7fed87fff700 1 -- 172.21.15.50:0/213285285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241923098 0 0) 0x7fed9805d360 con 0x7fed98139b00 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9db9c700 1 -- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 msgr2=0x7fed9805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9db9c700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 0x7fed9805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9db9c700 1 -- 172.21.15.50:0/213285285 >> v1:172.21.15.50:6789/0 conn(0x7fed98139b00 legacy=0x7fed9805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9db9c700 1 -- 172.21.15.50:0/213285285 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980a7c50 con 0x7fed9805d7d0 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9d39b700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 0x7fed9805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed9db9c700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 0x7fed981402a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fed900032f0 tx=0x7fed900091d0).ready entity=mon.2 client_cookie=36a545d65e83f09 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed87fff700 1 -- 172.21.15.50:0/213285285 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9000b6c0 con 0x7fed9805d7d0 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed87fff700 1 -- 172.21.15.50:0/213285285 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9000b820 con 0x7fed9805d7d0 2022-05-02T09:39:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.807+0000 7fed87fff700 1 -- 172.21.15.50:0/213285285 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9000b990 con 0x7fed9805d7d0 2022-05-02T09:39:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 -- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 msgr2=0x7fed981402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 0x7fed981402a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fed900032f0 tx=0x7fed900091d0).stop 2022-05-02T09:39:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 -- 172.21.15.50:0/213285285 shutdown_connections 2022-05-02T09:39:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed9805d7d0 0x7fed981402a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 --2- 172.21.15.50:0/213285285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed98139720 0x7fed9805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 -- 172.21.15.50:0/213285285 >> 172.21.15.50:0/213285285 conn(0x7fed980669d0 msgr2=0x7fed980a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 -- 172.21.15.50:0/213285285 shutdown_connections 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.808+0000 7fed9e39d700 1 -- 172.21.15.50:0/213285285 wait complete. 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.809+0000 7fed9e39d700 1 Processor -- start 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.809+0000 7fed9e39d700 1 -- start start 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 0x7fed980a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 0x7fed980a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980a2030 con 0x7fed98139b00 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980a22f0 con 0x7fed9805d7d0 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9e39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed980a6670 con 0x7fed98139720 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9d39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.810+0000 7fed9cb9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 0x7fed980a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9db9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 0x7fed980a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50390/0 (socket says 172.21.15.50:50390) 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 -- 172.21.15.50:0/4109016647 learned_addr learned my addr 172.21.15.50:0/4109016647 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 -- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 msgr2=0x7fed980a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 0x7fed980a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 -- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 msgr2=0x7fed980a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 0x7fed980a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 -- 172.21.15.50:0/4109016647 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9400b180 con 0x7fed9805d7d0 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9cb9a700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 0x7fed980a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9db9c700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 0x7fed980a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.811+0000 7fed9d39b700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed94006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.812+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94010780 con 0x7fed9805d7d0 2022-05-02T09:39:43.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.812+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed940108e0 con 0x7fed9805d7d0 2022-05-02T09:39:43.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.812+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed90009470 con 0x7fed9805d7d0 2022-05-02T09:39:43.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.812+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94010c40 con 0x7fed9805d7d0 2022-05-02T09:39:43.819 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.812+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980a1840 con 0x7fed9805d7d0 2022-05-02T09:39:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.813+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fed9401c460 con 0x7fed9805d7d0 2022-05-02T09:39:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.814+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed980a3320 con 0x7fed9805d7d0 2022-05-02T09:39:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.814+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fed9404a790 con 0x7fed9805d7d0 2022-05-02T09:39:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.817+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fed980a3320 con 0x7fed9805d7d0 2022-05-02T09:39:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:43.975+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed980a3320 con 0x7fed9805d7d0 2022-05-02T09:39:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.617+0000 7fed867fc700 1 -- 172.21.15.50:0/4109016647 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed980a3320 con 0x7fed9805d7d0 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 >> v1:172.21.15.50:6800/30011 conn(0x7fed78038a60 legacy=0x7fed7803af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 msgr2=0x7fed980a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed94006df0).stop 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 shutdown_connections 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed98139b00 0x7fed980a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed9805d7d0 0x7fed980a4320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 --2- 172.21.15.50:0/4109016647 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fed98139720 0x7fed980a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 >> 172.21.15.50:0/4109016647 conn(0x7fed980669d0 msgr2=0x7fed981387e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:44.623 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 shutdown_connections 2022-05-02T09:39:44.623 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.619+0000 7fed9e39d700 1 -- 172.21.15.50:0/4109016647 wait complete. 2022-05-02T09:39:44.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2022-05-02T09:39:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.855+0000 7fb25ffff700 1 Processor -- start 2022-05-02T09:39:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.856+0000 7fb25ffff700 1 -- start start 2022-05-02T09:39:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb260139b00 0x7fb26005d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb260139010 con 0x7fb260139b00 2022-05-02T09:39:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601392d0 con 0x7fb260139720 2022-05-02T09:39:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25ffff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600a7c50 con 0x7fb26005cc50 2022-05-02T09:39:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb260139b00 0x7fb26005d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb260139b00 0x7fb26005d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35820/0 (socket says 172.21.15.50:35820) 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49712/0 (socket says 172.21.15.50:49712) 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25e7fc700 1 -- 172.21.15.50:0/3887213439 learned_addr learned my addr 172.21.15.50:0/3887213439 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.857+0000 7fb25effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50394/0 (socket says 172.21.15.50:50394) 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 -- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 msgr2=0x7fb26005fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 -- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 msgr2=0x7fb26005b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 -- 172.21.15.50:0/3887213439 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600a95d0 con 0x7fb260139b00 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25f7fe700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25effd700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25e7fc700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139b00 0x7fb26005d7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb254002f70 tx=0x7fb254006eb0).ready entity=mon.0 client_cookie=e75ced4cee4ebeb7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25dffb700 1 -- 172.21.15.50:0/3887213439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25400d570 con 0x7fb260139b00 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.858+0000 7fb25dffb700 1 -- 172.21.15.50:0/3887213439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254000e90 con 0x7fb260139b00 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25dffb700 1 -- 172.21.15.50:0/3887213439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25400d900 con 0x7fb260139b00 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 -- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139b00 msgr2=0x7fb26005d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139b00 0x7fb26005d7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb254002f70 tx=0x7fb254006eb0).stop 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 -- 172.21.15.50:0/3887213439 shutdown_connections 2022-05-02T09:39:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb26005cc50 0x7fb26005fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb260139720 0x7fb26005b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 --2- 172.21.15.50:0/3887213439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139b00 0x7fb26005d7d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 -- 172.21.15.50:0/3887213439 >> 172.21.15.50:0/3887213439 conn(0x7fb2600669d0 msgr2=0x7fb2600a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 -- 172.21.15.50:0/3887213439 shutdown_connections 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.859+0000 7fb25ffff700 1 -- 172.21.15.50:0/3887213439 wait complete. 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.860+0000 7fb25ffff700 1 Processor -- start 2022-05-02T09:39:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.861+0000 7fb25ffff700 1 -- start start 2022-05-02T09:39:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.861+0000 7fb25ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb26005cc50 0x7fb2600a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.861+0000 7fb25ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 0x7fb260148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600a1c00 con 0x7fb260139720 2022-05-02T09:39:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260149740 con 0x7fb26005cc50 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25ffff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600a0ad0 con 0x7fb260139b00 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 0x7fb260148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49714/0 (socket says 172.21.15.50:49714) 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 -- 172.21.15.50:0/1609844318 learned_addr learned my addr 172.21.15.50:0/1609844318 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25effd700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb26005cc50 0x7fb2600a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 -- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb26005cc50 msgr2=0x7fb2600a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:44.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb26005cc50 0x7fb2600a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 -- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 msgr2=0x7fb260148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 0x7fb260148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25f7fe700 1 -- 172.21.15.50:0/1609844318 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009470 con 0x7fb260139b00 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.862+0000 7fb25e7fc700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 0x7fb260148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb25f7fe700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb25800c000 tx=0x7fb2580091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25800c850 con 0x7fb260139b00 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800c9b0 con 0x7fb260139b00 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25000b180 con 0x7fb260139b00 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25800cd10 con 0x7fb260139b00 2022-05-02T09:39:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.863+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25400b1e0 con 0x7fb260139b00 2022-05-02T09:39:44.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.864+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26005d100 con 0x7fb260139b00 2022-05-02T09:39:44.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.864+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fb258022070 con 0x7fb260139b00 2022-05-02T09:39:44.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.865+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb25804aa80 con 0x7fb260139b00 2022-05-02T09:39:44.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:44.868+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb2580335f0 con 0x7fb260139b00 2022-05-02T09:39:45.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.026+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fb260057990 con 0x7fb260139b00 2022-05-02T09:39:45.621 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.619+0000 7fb24ffff700 1 -- 172.21.15.50:0/1609844318 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v12) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb258016030 con 0x7fb260139b00 2022-05-02T09:39:45.624 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.622+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 >> v1:172.21.15.50:6800/30011 conn(0x7fb23c038970 legacy=0x7fb23c03ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:45.624 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.622+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 msgr2=0x7fb260149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.622+0000 7fb25ffff700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb25800c000 tx=0x7fb2580091d0).stop 2022-05-02T09:39:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 shutdown_connections 2022-05-02T09:39:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb260139b00 0x7fb260149250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb26005cc50 0x7fb2600a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 --2- 172.21.15.50:0/1609844318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb260139720 0x7fb260148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 >> 172.21.15.50:0/1609844318 conn(0x7fb2600669d0 msgr2=0x7fb2600ab420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.623+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 shutdown_connections 2022-05-02T09:39:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.624+0000 7fb25ffff700 1 -- 172.21.15.50:0/1609844318 wait complete. 2022-05-02T09:39:45.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:45.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.859+0000 7f3231dff700 1 Processor -- start 2022-05-02T09:39:45.862 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.859+0000 7f3231dff700 1 -- start start 2022-05-02T09:39:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 0x7f322c135e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c05da20 con 0x7f322c133660 2022-05-02T09:39:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c136d10 con 0x7f322c136370 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.860+0000 7f3231dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f322c139a30 con 0x7f322c133280 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 0x7f322c135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50398/0 (socket says 172.21.15.50:50398) 2022-05-02T09:39:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49716/0 (socket says 172.21.15.50:49716) 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 -- 172.21.15.50:0/4176834952 learned_addr learned my addr 172.21.15.50:0/4176834952 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 -- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 msgr2=0x7f322c139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 --2- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 -- 172.21.15.50:0/4176834952 >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 msgr2=0x7f322c135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 --2- 172.21.15.50:0/4176834952 >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 0x7f322c135e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322bfff700 1 -- 172.21.15.50:0/4176834952 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c139cd0 con 0x7f322c136370 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.861+0000 7f322affd700 1 --2- 172.21.15.50:0/4176834952 >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 0x7f322c135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f322bfff700 1 --2- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f32240032f0 tx=0x7f3224009290).ready entity=mon.1 client_cookie=3d5cfeafd336711e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f322a7fc700 1 -- 172.21.15.50:0/4176834952 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322400b6c0 con 0x7f322c136370 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f322a7fc700 1 -- 172.21.15.50:0/4176834952 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400b820 con 0x7f322c136370 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f322a7fc700 1 -- 172.21.15.50:0/4176834952 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322400b990 con 0x7f322c136370 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f3231dff700 1 -- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 msgr2=0x7f322c136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.862+0000 7f3231dff700 1 --2- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f32240032f0 tx=0x7f3224009290).stop 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 -- 172.21.15.50:0/4176834952 shutdown_connections 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 --2- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c136370 0x7f322c136820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 --2- 172.21.15.50:0/4176834952 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 --2- 172.21.15.50:0/4176834952 >> v2:172.21.15.50:3300/0 conn(0x7f322c133660 0x7f322c135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 -- 172.21.15.50:0/4176834952 >> 172.21.15.50:0/4176834952 conn(0x7f322c066e20 msgr2=0x7f322c05fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 -- 172.21.15.50:0/4176834952 shutdown_connections 2022-05-02T09:39:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.863+0000 7f3231dff700 1 -- 172.21.15.50:0/4176834952 wait complete. 2022-05-02T09:39:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.864+0000 7f3231dff700 1 Processor -- start 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.864+0000 7f3231dff700 1 -- start start 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c133660 0x7f322c12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f322c136370 0x7f322c12fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a5db0 con 0x7f322c136370 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a4a90 con 0x7f322c133660 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f3231dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a61a0 con 0x7f322c133280 2022-05-02T09:39:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f322b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f322affd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c133660 0x7f322c12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.865+0000 7f322b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49718/0 (socket says 172.21.15.50:49718) 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 -- 172.21.15.50:0/847440391 learned_addr learned my addr 172.21.15.50:0/847440391 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322bfff700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f322c136370 0x7f322c12fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 -- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c133660 msgr2=0x7f322c12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c133660 0x7f322c12f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 -- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f322c136370 msgr2=0x7f322c12fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f322c136370 0x7f322c12fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 -- 172.21.15.50:0/847440391 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322000b180 con 0x7f322c133280 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f322b7fe700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f321c00c000 tx=0x7f321c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.866+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321c010780 con 0x7f322c133280 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.867+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c0108e0 con 0x7f322c133280 2022-05-02T09:39:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.867+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3224009530 con 0x7f322c133280 2022-05-02T09:39:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.867+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321c010c40 con 0x7f322c133280 2022-05-02T09:39:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.867+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c149830 con 0x7f322c133280 2022-05-02T09:39:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.868+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f321c01c460 con 0x7f322c133280 2022-05-02T09:39:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.868+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c057990 con 0x7f322c133280 2022-05-02T09:39:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.868+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f321c04a660 con 0x7f322c133280 2022-05-02T09:39:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:45.872+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f321c0331d0 con 0x7f322c133280 2022-05-02T09:39:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.027+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f322c1354a0 con 0x7f322c133280 2022-05-02T09:39:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.028+0000 7f3228ff9700 1 -- 172.21.15.50:0/847440391 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f321c032dc0 con 0x7f322c133280 2022-05-02T09:39:46.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:46.031 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 >> v1:172.21.15.50:6800/30011 conn(0x7f320c038940 legacy=0x7f320c03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 msgr2=0x7f322c149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f321c00c000 tx=0x7f321c006df0).stop 2022-05-02T09:39:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 shutdown_connections 2022-05-02T09:39:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f322c133280 0x7f322c149340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f322c136370 0x7f322c12fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 --2- 172.21.15.50:0/847440391 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f322c133660 0x7f322c12f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 >> 172.21.15.50:0/847440391 conn(0x7f322c066e20 msgr2=0x7f322c135bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 shutdown_connections 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:46.030+0000 7f3231dff700 1 -- 172.21.15.50:0/847440391 wait complete. 2022-05-02T09:39:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:46.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:46.358 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:47.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:47.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.571+0000 7f760e99d700 1 Processor -- start 2022-05-02T09:39:47.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.571+0000 7f760e99d700 1 -- start start 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 0x7f760805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7608139b00 0x7f760805d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 0x7f760805fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7608139010 con 0x7f7608139b00 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76081392d0 con 0x7f760805cc50 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.572+0000 7f760e99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76080a7c50 con 0x7f7608139720 2022-05-02T09:39:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d99b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 0x7f760805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7608139b00 0x7f760805d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760e19c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 0x7f760805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7608139b00 0x7f760805d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35828/0 (socket says 172.21.15.50:35828) 2022-05-02T09:39:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d99b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 0x7f760805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49720/0 (socket says 172.21.15.50:49720) 2022-05-02T09:39:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 -- 172.21.15.50:0/619706347 learned_addr learned my addr 172.21.15.50:0/619706347 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 -- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 msgr2=0x7f760805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 0x7f760805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 -- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 msgr2=0x7f760805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 0x7f760805fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 -- 172.21.15.50:0/619706347 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080a95d0 con 0x7f7608139b00 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760e19c700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 0x7f760805fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.573+0000 7f760d19a700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f760805d7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f75f8002f70 tx=0x7f75f8006eb0).ready entity=mon.0 client_cookie=311590a5b94135fc server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760c999700 1 -- 172.21.15.50:0/619706347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f800d570 con 0x7f7608139b00 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760c999700 1 -- 172.21.15.50:0/619706347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8000e90 con 0x7f7608139b00 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760c999700 1 -- 172.21.15.50:0/619706347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f800d900 con 0x7f7608139b00 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 -- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 msgr2=0x7f760805d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f760805d7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f75f8002f70 tx=0x7f75f8006eb0).stop 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 -- 172.21.15.50:0/619706347 shutdown_connections 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760805cc50 0x7f760805fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7608139720 0x7f760805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 --2- 172.21.15.50:0/619706347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f760805d7d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 -- 172.21.15.50:0/619706347 >> 172.21.15.50:0/619706347 conn(0x7f76080669d0 msgr2=0x7f76080a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 -- 172.21.15.50:0/619706347 shutdown_connections 2022-05-02T09:39:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.574+0000 7f760e99d700 1 -- 172.21.15.50:0/619706347 wait complete. 2022-05-02T09:39:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.576+0000 7f760e99d700 1 Processor -- start 2022-05-02T09:39:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.576+0000 7f760e99d700 1 -- start start 2022-05-02T09:39:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7608139720 0x7f76080a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f76080a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080a19e0 con 0x7f7608139b00 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080a1c80 con 0x7f7608139720 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76080a1f40 con 0x7f760805cc50 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760d99b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760e19c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f76080a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760d99b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49722/0 (socket says 172.21.15.50:49722) 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760d99b700 1 -- 172.21.15.50:0/3033895222 learned_addr learned my addr 172.21.15.50:0/3033895222 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760d19a700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7608139720 0x7f76080a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.577+0000 7f760d99b700 1 -- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7608139720 msgr2=0x7f76080a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760d99b700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7608139720 0x7f76080a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760d99b700 1 -- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 msgr2=0x7f76080a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760d99b700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f76080a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760d99b700 1 -- 172.21.15.50:0/3033895222 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009470 con 0x7f760805cc50 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760e19c700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f76080a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760d99b700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f760400c000 tx=0x7f7604006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604010780 con 0x7f760805cc50 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76040108e0 con 0x7f760805cc50 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f800b1e0 con 0x7f760805cc50 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604010c40 con 0x7f760805cc50 2022-05-02T09:39:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.578+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76080a35e0 con 0x7f760805cc50 2022-05-02T09:39:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.579+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760805d100 con 0x7f760805cc50 2022-05-02T09:39:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.579+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f760401c460 con 0x7f760805cc50 2022-05-02T09:39:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.580+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f760404a790 con 0x7f760805cc50 2022-05-02T09:39:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.583+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7604033260 con 0x7f760805cc50 2022-05-02T09:39:47.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.740+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7608057990 con 0x7f760805cc50 2022-05-02T09:39:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.741+0000 7f75f6ffd700 1 -- 172.21.15.50:0/3033895222 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7604032e50 con 0x7f760805cc50 2022-05-02T09:39:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:47.743 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 >> v1:172.21.15.50:6800/30011 conn(0x7f75e8038970 legacy=0x7f75e803ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 msgr2=0x7f7608135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f760400c000 tx=0x7f7604006df0).stop 2022-05-02T09:39:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 shutdown_connections 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f760805cc50 0x7f7608135b60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7608139b00 0x7f76080a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.742+0000 7f760e99d700 1 --2- 172.21.15.50:0/3033895222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7608139720 0x7f76080a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.743+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 >> 172.21.15.50:0/3033895222 conn(0x7f76080669d0 msgr2=0x7f76081373a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.743+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 shutdown_connections 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:47.743+0000 7f760e99d700 1 -- 172.21.15.50:0/3033895222 wait complete. 2022-05-02T09:39:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:48.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:48.071 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:49.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.284+0000 7f1d9359e700 1 Processor -- start 2022-05-02T09:39:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.284+0000 7f1d9359e700 1 -- start start 2022-05-02T09:39:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 0x7f1d941327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d94136140 0x7f1d941365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940a7270 con 0x7f1d94136140 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94094760 con 0x7f1d940a6e90 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9359e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94135ea0 con 0x7f1d94095430 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d91d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d92d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d94136140 0x7f1d941365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 0x7f1d941327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d91d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49724/0 (socket says 172.21.15.50:49724) 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 0x7f1d941327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50406/0 (socket says 172.21.15.50:50406) 2022-05-02T09:39:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d91d9b700 1 -- 172.21.15.50:0/2520917407 learned_addr learned my addr 172.21.15.50:0/2520917407 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.285+0000 7f1d92d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d94136140 0x7f1d941365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35832/0 (socket says 172.21.15.50:35832) 2022-05-02T09:39:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 msgr2=0x7f1d941330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 msgr2=0x7f1d941327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 0x7f1d941327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2520917407 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d941335a0 con 0x7f1d94136140 2022-05-02T09:39:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d91d9b700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94136140 0x7f1d941365d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1d8c0032f0 tx=0x7f1d8c0091d0).ready entity=mon.0 client_cookie=af3be6234e1771b3 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.286+0000 7f1d9159a700 1 -- 172.21.15.50:0/2520917407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c00b600 con 0x7f1d94136140 2022-05-02T09:39:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9159a700 1 -- 172.21.15.50:0/2520917407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00b760 con 0x7f1d94136140 2022-05-02T09:39:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9159a700 1 -- 172.21.15.50:0/2520917407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c00b8d0 con 0x7f1d94136140 2022-05-02T09:39:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 -- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94136140 msgr2=0x7f1d941365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94136140 0x7f1d941365d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1d8c0032f0 tx=0x7f1d8c0091d0).stop 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 -- 172.21.15.50:0/2520917407 shutdown_connections 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94136140 0x7f1d941365d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d940a6e90 0x7f1d941327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2520917407 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d94095430 0x7f1d941330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 -- 172.21.15.50:0/2520917407 >> 172.21.15.50:0/2520917407 conn(0x7f1d9405b8a0 msgr2=0x7f1d9405bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 -- 172.21.15.50:0/2520917407 shutdown_connections 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.287+0000 7f1d9359e700 1 -- 172.21.15.50:0/2520917407 wait complete. 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.288+0000 7f1d9359e700 1 Processor -- start 2022-05-02T09:39:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.288+0000 7f1d9359e700 1 -- start start 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 0x7f1d94144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d940a6e90 0x7f1d94060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 0x7f1d940612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94064550 con 0x7f1d94095430 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940646e0 con 0x7f1d94136140 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.289+0000 7f1d9359e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94064050 con 0x7f1d940a6e90 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 0x7f1d94144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 0x7f1d940612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d91d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d940a6e90 0x7f1d94060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 0x7f1d94144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35834/0 (socket says 172.21.15.50:35834) 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d9259c700 1 -- 172.21.15.50:0/2741234420 learned_addr learned my addr 172.21.15.50:0/2741234420 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d940a6e90 msgr2=0x7f1d94060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d940a6e90 0x7f1d94060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 msgr2=0x7f1d94144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 0x7f1d94144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 -- 172.21.15.50:0/2741234420 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8800d660 con 0x7f1d94136140 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.290+0000 7f1d92d9d700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 0x7f1d940612b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1d8c0032f0 tx=0x7f1d8c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.291+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c00b600 con 0x7f1d94136140 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.291+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c011d50 con 0x7f1d94136140 2022-05-02T09:39:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.291+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c0205f0 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.291+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c009470 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.291+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d94144b50 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.292+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f1d8c01e070 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.292+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d94064890 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.293+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1d8c04ad00 con 0x7f1d94136140 2022-05-02T09:39:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.296+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1d94064890 con 0x7f1d94136140 2022-05-02T09:39:49.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.452+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d94064890 con 0x7f1d94136140 2022-05-02T09:39:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.453+0000 7f1d837fe700 1 -- 172.21.15.50:0/2741234420 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f1d8c015930 con 0x7f1d94136140 2022-05-02T09:39:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:49.456 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.454+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 >> v1:172.21.15.50:6800/30011 conn(0x7f1d700389d0 legacy=0x7f1d7003ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.454+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 msgr2=0x7f1d940612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.454+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 0x7f1d940612b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1d8c0032f0 tx=0x7f1d8c016000).stop 2022-05-02T09:39:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.454+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 shutdown_connections 2022-05-02T09:39:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1d94136140 0x7f1d940612b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d94095430 0x7f1d94144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 --2- 172.21.15.50:0/2741234420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1d940a6e90 0x7f1d94060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 >> 172.21.15.50:0/2741234420 conn(0x7f1d9405b8a0 msgr2=0x7f1d940a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 shutdown_connections 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:49.455+0000 7f1d9359e700 1 -- 172.21.15.50:0/2741234420 wait complete. 2022-05-02T09:39:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:49.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:49.783 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:50.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.000+0000 7fd46f19d700 1 Processor -- start 2022-05-02T09:39:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.000+0000 7fd46f19d700 1 -- start start 2022-05-02T09:39:51.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.001+0000 7fd46f19d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd468139b00 0x7fd46805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:51.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.001+0000 7fd46f19d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 0x7fd4681402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:51.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.001+0000 7fd46f19d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46805d360 con 0x7fd468139720 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.001+0000 7fd46f19d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd468139010 con 0x7fd468139b00 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.001+0000 7fd46f19d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681392d0 con 0x7fd46805d7d0 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46e19b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd468139720 0x7fd46805cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52228/0 (socket says 172.21.15.50:52228) 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46e19b700 1 -- 172.21.15.50:0/2946435017 learned_addr learned my addr 172.21.15.50:0/2946435017 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d99a700 1 --2- 172.21.15.50:0/2946435017 >> v2:172.21.15.50:3300/0 conn(0x7fd468139b00 0x7fd46805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46e99c700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 0x7fd4681402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d199700 1 -- 172.21.15.50:0/2946435017 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941597899 0 0) 0x7fd46805d360 con 0x7fd468139720 2022-05-02T09:39:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d199700 1 -- 172.21.15.50:0/2946435017 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003260 con 0x7fd468139720 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d99a700 1 -- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 msgr2=0x7fd4681402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d99a700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 0x7fd4681402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d99a700 1 -- 172.21.15.50:0/2946435017 >> v1:172.21.15.50:6789/0 conn(0x7fd468139720 legacy=0x7fd46805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46d99a700 1 -- 172.21.15.50:0/2946435017 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680a7c50 con 0x7fd468139b00 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.002+0000 7fd46e99c700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 0x7fd4681402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46d99a700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468139b00 0x7fd46805b8a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458006df0).ready entity=mon.0 client_cookie=fa6c0d52ae112600 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46d199700 1 -- 172.21.15.50:0/2946435017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45800d4a0 con 0x7fd468139b00 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46d199700 1 -- 172.21.15.50:0/2946435017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458000e90 con 0x7fd468139b00 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46d199700 1 -- 172.21.15.50:0/2946435017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45800d7f0 con 0x7fd468139b00 2022-05-02T09:39:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46f19d700 1 -- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468139b00 msgr2=0x7fd46805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.003+0000 7fd46f19d700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468139b00 0x7fd46805b8a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458006df0).stop 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 -- 172.21.15.50:0/2946435017 shutdown_connections 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd46805d7d0 0x7fd4681402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 --2- 172.21.15.50:0/2946435017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468139b00 0x7fd46805b8a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 -- 172.21.15.50:0/2946435017 >> 172.21.15.50:0/2946435017 conn(0x7fd4680669d0 msgr2=0x7fd4680a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 -- 172.21.15.50:0/2946435017 shutdown_connections 2022-05-02T09:39:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.004+0000 7fd46f19d700 1 -- 172.21.15.50:0/2946435017 wait complete. 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.005+0000 7fd46f19d700 1 Processor -- start 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.005+0000 7fd46f19d700 1 -- start start 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 0x7fd468132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd468139b00 0x7fd468132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468063aa0 con 0x7fd46805d7d0 2022-05-02T09:39:51.012 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468063c10 con 0x7fd468139720 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46f19d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd468064960 con 0x7fd468139b00 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46e19b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46e19b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35838/0 (socket says 172.21.15.50:35838) 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46e19b700 1 -- 172.21.15.50:0/648906480 learned_addr learned my addr 172.21.15.50:0/648906480 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46e99c700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd468139b00 0x7fd468132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.007+0000 7fd46d99a700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 0x7fd468132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 -- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd468139b00 msgr2=0x7fd468132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd468139b00 0x7fd468132a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 -- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 msgr2=0x7fd468064170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.013 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 -- 172.21.15.50:0/648906480 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009470 con 0x7fd468139720 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46e19b700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46d99a700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 0x7fd468132510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd458016070 con 0x7fd468139720 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580138d0 con 0x7fd468139720 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45800b180 con 0x7fd468139720 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd458013c30 con 0x7fd468139720 2022-05-02T09:39:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.008+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd468062de0 con 0x7fd468139720 2022-05-02T09:39:51.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.010+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fd458025030 con 0x7fd468139720 2022-05-02T09:39:51.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.010+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd468057990 con 0x7fd468139720 2022-05-02T09:39:51.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.010+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd45804b360 con 0x7fd468139720 2022-05-02T09:39:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.013+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd45801ffe0 con 0x7fd468139720 2022-05-02T09:39:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.170+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd468061b40 con 0x7fd468139720 2022-05-02T09:39:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.170+0000 7fd4577fe700 1 -- 172.21.15.50:0/648906480 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fd458006980 con 0x7fd468139720 2022-05-02T09:39:51.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:51.173 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 >> v1:172.21.15.50:6800/30011 conn(0x7fd4480389d0 legacy=0x7fd44803ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 msgr2=0x7fd468132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 0x7fd468132510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458014000).stop 2022-05-02T09:39:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 shutdown_connections 2022-05-02T09:39:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd468139b00 0x7fd468132a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd46805d7d0 0x7fd468064170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 --2- 172.21.15.50:0/648906480 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd468139720 0x7fd468132510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 >> 172.21.15.50:0/648906480 conn(0x7fd4680669d0 msgr2=0x7fd46805cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 shutdown_connections 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:51.172+0000 7fd46f19d700 1 -- 172.21.15.50:0/648906480 wait complete. 2022-05-02T09:39:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:51.500 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:51.500 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:52.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:52.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.715+0000 7f7ad259d700 1 Processor -- start 2022-05-02T09:39:52.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.715+0000 7f7ad259d700 1 -- start start 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad259d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 0x7f7acc0a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad259d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 0x7f7acc1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad259d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc135dc0 con 0x7f7acc136280 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad259d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc135bd0 con 0x7f7acc13e4d0 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad259d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc062980 con 0x7f7acc136660 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad159b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7acc136280 0x7f7acc063080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52230/0 (socket says 172.21.15.50:52230) 2022-05-02T09:39:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad159b700 1 -- 172.21.15.50:0/1864140901 learned_addr learned my addr 172.21.15.50:0/1864140901 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1864140901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 0x7f7acc0a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.716+0000 7f7ad1d9c700 1 --2- 172.21.15.50:0/1864140901 >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 0x7f7acc1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7abbfff700 1 -- 172.21.15.50:0/1864140901 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314942042 0 0) 0x7f7acc135dc0 con 0x7f7acc136280 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7abbfff700 1 -- 172.21.15.50:0/1864140901 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab4003260 con 0x7f7acc136280 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1864140901 >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 msgr2=0x7f7acc1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1864140901 >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 0x7f7acc1408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1864140901 >> v1:172.21.15.50:6789/0 conn(0x7f7acc136280 legacy=0x7f7acc063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1864140901 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc136060 con 0x7f7acc136660 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad1d9c700 1 --2- 172.21.15.50:0/1864140901 >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 0x7f7acc1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.717+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1864140901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 0x7f7acc0a95e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7abc002f70 tx=0x7f7abc006df0).ready entity=mon.1 client_cookie=956a7f9db019227b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7abbfff700 1 -- 172.21.15.50:0/1864140901 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc00d4a0 con 0x7f7acc136660 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7abbfff700 1 -- 172.21.15.50:0/1864140901 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc000e90 con 0x7f7acc136660 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7abbfff700 1 -- 172.21.15.50:0/1864140901 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc00d7f0 con 0x7f7acc136660 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 -- 172.21.15.50:0/1864140901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 msgr2=0x7f7acc0a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1864140901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 0x7f7acc0a95e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7abc002f70 tx=0x7f7abc006df0).stop 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 -- 172.21.15.50:0/1864140901 shutdown_connections 2022-05-02T09:39:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1864140901 >> v2:172.21.15.50:3300/0 conn(0x7f7acc13e4d0 0x7f7acc1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1864140901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136660 0x7f7acc0a95e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 -- 172.21.15.50:0/1864140901 >> 172.21.15.50:0/1864140901 conn(0x7f7acc05c9b0 msgr2=0x7f7acc05cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 -- 172.21.15.50:0/1864140901 shutdown_connections 2022-05-02T09:39:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.718+0000 7f7ad259d700 1 -- 172.21.15.50:0/1864140901 wait complete. 2022-05-02T09:39:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.720+0000 7f7ad259d700 1 Processor -- start 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.720+0000 7f7ad259d700 1 -- start start 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7acc13e4d0 0x7f7acc137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc094010 con 0x7f7acc136660 2022-05-02T09:39:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc137280 con 0x7f7acc136280 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.721+0000 7f7ad259d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc137520 con 0x7f7acc13e4d0 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad159b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35842/0 (socket says 172.21.15.50:35842) 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1729553254 learned_addr learned my addr 172.21.15.50:0/1729553254 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad159b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50416/0 (socket says 172.21.15.50:50416) 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad1d9c700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7acc13e4d0 0x7f7acc137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7acc13e4d0 msgr2=0x7f7acc137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7acc13e4d0 0x7f7acc137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 msgr2=0x7f7acc092400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad0d9a700 1 -- 172.21.15.50:0/1729553254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009470 con 0x7f7acc136660 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.722+0000 7f7ad159b700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7ad0d9a700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7abc002f70 tx=0x7f7abc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc016070 con 0x7f7acc136660 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0138d0 con 0x7f7acc136660 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc00b180 con 0x7f7acc136660 2022-05-02T09:39:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc013c30 con 0x7f7acc136660 2022-05-02T09:39:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.723+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc136ff0 con 0x7f7acc136660 2022-05-02T09:39:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.724+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f7abc025030 con 0x7f7acc136660 2022-05-02T09:39:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.724+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc0a9ad0 con 0x7f7acc136660 2022-05-02T09:39:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.725+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7abc04b4c0 con 0x7f7acc136660 2022-05-02T09:39:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.728+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7abc01f930 con 0x7f7acc136660 2022-05-02T09:39:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.883+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7acc057990 con 0x7f7acc136660 2022-05-02T09:39:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.883+0000 7f7aba7fc700 1 -- 172.21.15.50:0/1729553254 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7abc020ed0 con 0x7f7acc136660 2022-05-02T09:39:52.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:52.886 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 >> v1:172.21.15.50:6800/30011 conn(0x7f7aac038940 legacy=0x7f7aac03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 msgr2=0x7f7acc137760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7abc002f70 tx=0x7f7abc014000).stop 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 shutdown_connections 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7acc13e4d0 0x7f7acc137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7acc136280 0x7f7acc092400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 --2- 172.21.15.50:0/1729553254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7acc136660 0x7f7acc137760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.885+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 >> 172.21.15.50:0/1729553254 conn(0x7f7acc05c9b0 msgr2=0x7f7acc133f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.886+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 shutdown_connections 2022-05-02T09:39:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:52.886+0000 7f7ad259d700 1 -- 172.21.15.50:0/1729553254 wait complete. 2022-05-02T09:39:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:53.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:53.214 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:54.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:54.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.426+0000 7fcb80b9d700 1 Processor -- start 2022-05-02T09:39:54.429 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.427+0000 7fcb80b9d700 1 -- start start 2022-05-02T09:39:54.431 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.427+0000 7fcb80b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 0x7fcb7c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb80b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb80b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c05d360 con 0x7fcb7c139b00 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb80b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c139010 con 0x7fcb7c139720 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb80b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c1392d0 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb7b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 0x7fcb7c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb7affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb7c139b00 0x7fcb7c05cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52232/0 (socket says 172.21.15.50:52232) 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.428+0000 7fcb7affd700 1 -- 172.21.15.50:0/1313783950 learned_addr learned my addr 172.21.15.50:0/1313783950 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:39:54.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7bfff700 1 -- 172.21.15.50:0/1313783950 >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 msgr2=0x7fcb7c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7bfff700 1 --2- 172.21.15.50:0/1313783950 >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 0x7fcb7c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7bfff700 1 -- 172.21.15.50:0/1313783950 >> v1:172.21.15.50:6789/0 conn(0x7fcb7c139b00 legacy=0x7fcb7c05cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7bfff700 1 -- 172.21.15.50:0/1313783950 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0a7c50 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7b7fe700 1 --2- 172.21.15.50:0/1313783950 >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 0x7fcb7c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7bfff700 1 --2- 172.21.15.50:0/1313783950 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c1402a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcb740032f0 tx=0x7fcb740091d0).ready entity=mon.2 client_cookie=899a4776392c62cc server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7a7fc700 1 -- 172.21.15.50:0/1313783950 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7400b6c0 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.433 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7a7fc700 1 -- 172.21.15.50:0/1313783950 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7400b820 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.434 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.429+0000 7fcb7a7fc700 1 -- 172.21.15.50:0/1313783950 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7400b990 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 -- 172.21.15.50:0/1313783950 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 msgr2=0x7fcb7c1402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/1313783950 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c1402a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcb740032f0 tx=0x7fcb740091d0).stop 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 -- 172.21.15.50:0/1313783950 shutdown_connections 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/1313783950 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c1402a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/1313783950 >> v2:172.21.15.50:3300/0 conn(0x7fcb7c139720 0x7fcb7c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 -- 172.21.15.50:0/1313783950 >> 172.21.15.50:0/1313783950 conn(0x7fcb7c0669d0 msgr2=0x7fcb7c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:54.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 -- 172.21.15.50:0/1313783950 shutdown_connections 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.430+0000 7fcb80b9d700 1 -- 172.21.15.50:0/1313783950 wait complete. 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.431+0000 7fcb80b9d700 1 Processor -- start 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.431+0000 7fcb80b9d700 1 -- start start 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb7c139720 0x7fcb7c145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0a0e80 con 0x7fcb7c139b00 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0a0ff0 con 0x7fcb7c139720 2022-05-02T09:39:54.438 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.432+0000 7fcb80b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c145390 con 0x7fcb7c05d7d0 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35846/0 (socket says 172.21.15.50:35846) 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 -- 172.21.15.50:0/2776911298 learned_addr learned my addr 172.21.15.50:0/2776911298 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49736/0 (socket says 172.21.15.50:49736) 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7affd700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb7c139720 0x7fcb7c145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 -- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 msgr2=0x7fcb7c0a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 -- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb7c139720 msgr2=0x7fcb7c145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb7c139720 0x7fcb7c145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 -- 172.21.15.50:0/2776911298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c00b180 con 0x7fcb7c139b00 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7b7fe700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.433+0000 7fcb7bfff700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcb740032f0 tx=0x7fcb74016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.434+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb74011d50 con 0x7fcb7c139b00 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.434+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74021440 con 0x7fcb7c139b00 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.434+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb740217a0 con 0x7fcb7c139b00 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.434+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74009470 con 0x7fcb7c139b00 2022-05-02T09:39:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.434+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c131d00 con 0x7fcb7c139b00 2022-05-02T09:39:54.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.435+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fcb74027020 con 0x7fcb7c139b00 2022-05-02T09:39:54.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.435+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c0a1180 con 0x7fcb7c139b00 2022-05-02T09:39:54.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.436+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcb7404b720 con 0x7fcb7c139b00 2022-05-02T09:39:54.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.438+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcb74021900 con 0x7fcb7c139b00 2022-05-02T09:39:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.593+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb7c057990 con 0x7fcb7c139b00 2022-05-02T09:39:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.594+0000 7fcb78ff9700 1 -- 172.21.15.50:0/2776911298 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fcb74015030 con 0x7fcb7c139b00 2022-05-02T09:39:54.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:54.599 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 >> v1:172.21.15.50:6800/30011 conn(0x7fcb5c0389d0 legacy=0x7fcb5c03ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 msgr2=0x7fcb7c145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcb740032f0 tx=0x7fcb74016000).stop 2022-05-02T09:39:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 shutdown_connections 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcb7c05d7d0 0x7fcb7c0a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb7c139b00 0x7fcb7c145b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 --2- 172.21.15.50:0/2776911298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcb7c139720 0x7fcb7c145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 >> 172.21.15.50:0/2776911298 conn(0x7fcb7c0669d0 msgr2=0x7fcb7c05cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 shutdown_connections 2022-05-02T09:39:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:54.596+0000 7fcb80b9d700 1 -- 172.21.15.50:0/2776911298 wait complete. 2022-05-02T09:39:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:54.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:54.924 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:55.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:56.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.137+0000 7f700c99d700 1 Processor -- start 2022-05-02T09:39:56.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.137+0000 7f700c99d700 1 -- start start 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f700c99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7008139b00 0x7f700805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f700c99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70081402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f700c99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700805d360 con 0x7f7008139720 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f700c99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7008139010 con 0x7f7008139b00 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f700c99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70081392d0 con 0x7f700805d7d0 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f7006ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7008139b00 0x7f700805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f7007fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70081402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f7006ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7008139b00 0x7f700805b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35848/0 (socket says 172.21.15.50:35848) 2022-05-02T09:39:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.138+0000 7f7006ffd700 1 -- 172.21.15.50:0/609910847 learned_addr learned my addr 172.21.15.50:0/609910847 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7006ffd700 1 -- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 msgr2=0x7f70081402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7006ffd700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70081402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7006ffd700 1 -- 172.21.15.50:0/609910847 >> v1:172.21.15.50:6789/0 conn(0x7f7008139720 legacy=0x7f700805cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7006ffd700 1 -- 172.21.15.50:0/609910847 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080a7c50 con 0x7f7008139b00 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7007fff700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70081402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f7006ffd700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139b00 0x7f700805b8a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ffc002f70 tx=0x7f6ffc006eb0).ready entity=mon.0 client_cookie=954c5e723c6a4949 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f70067fc700 1 -- 172.21.15.50:0/609910847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ffc00d570 con 0x7f7008139b00 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f70067fc700 1 -- 172.21.15.50:0/609910847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc000e90 con 0x7f7008139b00 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.139+0000 7f70067fc700 1 -- 172.21.15.50:0/609910847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ffc00d900 con 0x7f7008139b00 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 -- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139b00 msgr2=0x7f700805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139b00 0x7f700805b8a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ffc002f70 tx=0x7f6ffc006eb0).stop 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 -- 172.21.15.50:0/609910847 shutdown_connections 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70081402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 --2- 172.21.15.50:0/609910847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139b00 0x7f700805b8a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 -- 172.21.15.50:0/609910847 >> 172.21.15.50:0/609910847 conn(0x7f70080669d0 msgr2=0x7f70080a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 -- 172.21.15.50:0/609910847 shutdown_connections 2022-05-02T09:39:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.140+0000 7f700c99d700 1 -- 172.21.15.50:0/609910847 wait complete. 2022-05-02T09:39:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.141+0000 7f700c99d700 1 Processor -- start 2022-05-02T09:39:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 -- start start 2022-05-02T09:39:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70080a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7008139b00 0x7f700812e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080a38e0 con 0x7f7008139720 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080a26b0 con 0x7f700805d7d0 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.142+0000 7f700c99d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70080a2970 con 0x7f7008139b00 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f70077fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70080a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7007fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7008139b00 0x7f700812e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35850/0 (socket says 172.21.15.50:35850) 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 -- 172.21.15.50:0/2796185404 learned_addr learned my addr 172.21.15.50:0/2796185404 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 -- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7008139b00 msgr2=0x7f700812e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7008139b00 0x7f700812e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 -- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 msgr2=0x7f70080a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70080a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f7006ffd700 1 -- 172.21.15.50:0/2796185404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009470 con 0x7f7008139720 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.143+0000 7f70077fe700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70080a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f7006ffd700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6ffc002f70 tx=0x7f6ffc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ffc0117e0 con 0x7f7008139720 2022-05-02T09:39:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc011940 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc00b1e0 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ffc011ca0 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.144+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700812ebc0 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.145+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f6ffc025030 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.145+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080a42f0 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.146+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6ffc04b6c0 con 0x7f7008139720 2022-05-02T09:39:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.149+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f70080a42f0 con 0x7f7008139720 2022-05-02T09:39:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.304+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70080a42f0 con 0x7f7008139720 2022-05-02T09:39:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.304+0000 7f7004ff9700 1 -- 172.21.15.50:0/2796185404 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f70080a42f0 con 0x7f7008139720 2022-05-02T09:39:56.307 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:56.307 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 >> v1:172.21.15.50:6800/30011 conn(0x7f6fe8038940 legacy=0x7f6fe803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 msgr2=0x7f700812e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6ffc002f70 tx=0x7f6ffc015000).stop 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 shutdown_connections 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7008139b00 0x7f700812e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f700805d7d0 0x7f70080a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 --2- 172.21.15.50:0/2796185404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7008139720 0x7f700812e1e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 >> 172.21.15.50:0/2796185404 conn(0x7f70080669d0 msgr2=0x7f700806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 shutdown_connections 2022-05-02T09:39:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:56.306+0000 7f700c99d700 1 -- 172.21.15.50:0/2796185404 wait complete. 2022-05-02T09:39:56.310 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:56.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:56.633 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:57.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:57.854 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.847+0000 7f7df359d700 1 Processor -- start 2022-05-02T09:39:57.854 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.847+0000 7f7df359d700 1 -- start start 2022-05-02T09:39:57.854 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7dec139720 0x7f7dec05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.854 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139b00 0x7f7dec05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.855 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 0x7f7dec05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.855 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec139010 con 0x7f7dec139720 2022-05-02T09:39:57.855 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec1392d0 con 0x7f7dec05cc50 2022-05-02T09:39:57.855 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a7c50 con 0x7f7dec139b00 2022-05-02T09:39:57.855 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.848+0000 7f7df259b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7dec139720 0x7f7dec05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7dec139720 0x7f7dec05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35852/0 (socket says 172.21.15.50:35852) 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 -- 172.21.15.50:0/121355578 learned_addr learned my addr 172.21.15.50:0/121355578 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df2d9c700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 0x7f7dec05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df1d9a700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139b00 0x7f7dec05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 -- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139b00 msgr2=0x7f7dec05d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139b00 0x7f7dec05d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.857 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 -- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 msgr2=0x7f7dec05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:57.857 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 0x7f7dec05fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.857 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 -- 172.21.15.50:0/121355578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0a95d0 con 0x7f7dec139720 2022-05-02T09:39:57.857 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df2d9c700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 0x7f7dec05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:57.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.849+0000 7f7df259b700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec139720 0x7f7dec05b8a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8006eb0).ready entity=mon.0 client_cookie=4868fd7aa812116 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:57.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df1599700 1 -- 172.21.15.50:0/121355578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de800d570 con 0x7f7dec139720 2022-05-02T09:39:57.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df1599700 1 -- 172.21.15.50:0/121355578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8000e90 con 0x7f7dec139720 2022-05-02T09:39:57.858 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df1599700 1 -- 172.21.15.50:0/121355578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de800d900 con 0x7f7dec139720 2022-05-02T09:39:57.859 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 -- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec139720 msgr2=0x7f7dec05b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:57.859 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec139720 0x7f7dec05b8a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8006eb0).stop 2022-05-02T09:39:57.859 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 -- 172.21.15.50:0/121355578 shutdown_connections 2022-05-02T09:39:57.859 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec05cc50 0x7f7dec05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.860 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec139720 0x7f7dec05b8a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.860 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.850+0000 7f7df359d700 1 --2- 172.21.15.50:0/121355578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139b00 0x7f7dec05d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.860 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.851+0000 7f7df359d700 1 -- 172.21.15.50:0/121355578 >> 172.21.15.50:0/121355578 conn(0x7f7dec0669d0 msgr2=0x7f7dec0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:57.860 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.851+0000 7f7df359d700 1 -- 172.21.15.50:0/121355578 shutdown_connections 2022-05-02T09:39:57.860 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.851+0000 7f7df359d700 1 -- 172.21.15.50:0/121355578 wait complete. 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.852+0000 7f7df359d700 1 Processor -- start 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.852+0000 7f7df359d700 1 -- start start 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 0x7f7dec061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 0x7f7dec0623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec064a90 con 0x7f7dec05cc50 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec065c40 con 0x7f7dec139b00 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df359d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a08c0 con 0x7f7dec139720 2022-05-02T09:39:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df2d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 0x7f7dec0623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35854/0 (socket says 172.21.15.50:35854) 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df1d9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 0x7f7dec061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.854+0000 7f7df259b700 1 -- 172.21.15.50:0/2273758414 learned_addr learned my addr 172.21.15.50:0/2273758414 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 -- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 msgr2=0x7f7dec061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 0x7f7dec061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 -- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 msgr2=0x7f7dec0623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 0x7f7dec0623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 -- 172.21.15.50:0/2273758414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009470 con 0x7f7dec05cc50 2022-05-02T09:39:57.865 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df1d9a700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 0x7f7dec061eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df2d9c700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 0x7f7dec0623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df259b700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de800dea0 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8006b40 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de800b1e0 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de8011e20 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.855+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec0a65b0 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.856+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f7de8025030 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.856+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec065dd0 con 0x7f7dec05cc50 2022-05-02T09:39:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.857+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7de804b4c0 con 0x7f7dec05cc50 2022-05-02T09:39:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:57.860+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7de801e460 con 0x7f7dec05cc50 2022-05-02T09:39:58.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.016+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dec05d0e0 con 0x7f7dec05cc50 2022-05-02T09:39:58.019 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.017+0000 7f7ddb7fe700 1 -- 172.21.15.50:0/2273758414 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7de8023070 con 0x7f7dec05cc50 2022-05-02T09:39:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:58.020 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:58.021 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.018+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 >> v1:172.21.15.50:6800/30011 conn(0x7f7dcc038940 legacy=0x7f7dcc03ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:58.021 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.018+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 msgr2=0x7f7dec0640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:58.021 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.018+0000 7f7df359d700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8015000).stop 2022-05-02T09:39:58.021 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 shutdown_connections 2022-05-02T09:39:58.021 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dec139b00 0x7f7dec0623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dec05cc50 0x7f7dec0640c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 --2- 172.21.15.50:0/2273758414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7dec139720 0x7f7dec061eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 >> 172.21.15.50:0/2273758414 conn(0x7f7dec0669d0 msgr2=0x7f7dec05fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 shutdown_connections 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:58.019+0000 7f7df359d700 1 -- 172.21.15.50:0/2273758414 wait complete. 2022-05-02T09:39:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:39:58.347 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:39:58.347 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:39:59.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:39:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.561+0000 7f81b559d700 1 Processor -- start 2022-05-02T09:39:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.561+0000 7f81b559d700 1 -- start start 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81b0139b00 0x7f81b005d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b005fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b0139010 con 0x7f81b0139b00 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01392d0 con 0x7f81b005cc50 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b559d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a7c50 con 0x7f81b0139720 2022-05-02T09:39:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81affff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.562+0000 7f81b4d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81af7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81b0139b00 0x7f81b005d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81b4d9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b005fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50428/0 (socket says 172.21.15.50:50428) 2022-05-02T09:39:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81b4d9c700 1 -- 172.21.15.50:0/706350891 learned_addr learned my addr 172.21.15.50:0/706350891 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49744/0 (socket says 172.21.15.50:49744) 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 -- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 msgr2=0x7f81b005fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 --2- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b005fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 -- 172.21.15.50:0/706350891 >> v2:172.21.15.50:3300/0 conn(0x7f81b0139b00 msgr2=0x7f81b005d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 --2- 172.21.15.50:0/706350891 >> v2:172.21.15.50:3300/0 conn(0x7f81b0139b00 0x7f81b005d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 -- 172.21.15.50:0/706350891 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00a95d0 con 0x7f81b0139720 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.563+0000 7f81affff700 1 --2- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f81a0002f70 tx=0x7f81a0006df0).ready entity=mon.2 client_cookie=e2baa2b70b3a689a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81aeffd700 1 -- 172.21.15.50:0/706350891 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a000d4a0 con 0x7f81b0139720 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81aeffd700 1 -- 172.21.15.50:0/706350891 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0000e90 con 0x7f81b0139720 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81aeffd700 1 -- 172.21.15.50:0/706350891 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a000d7f0 con 0x7f81b0139720 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 -- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 msgr2=0x7f81b005b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 --2- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f81a0002f70 tx=0x7f81a0006df0).stop 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 -- 172.21.15.50:0/706350891 shutdown_connections 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 --2- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b005fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 --2- 172.21.15.50:0/706350891 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b005b8a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 --2- 172.21.15.50:0/706350891 >> v2:172.21.15.50:3300/0 conn(0x7f81b0139b00 0x7f81b005d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 -- 172.21.15.50:0/706350891 >> 172.21.15.50:0/706350891 conn(0x7f81b00669d0 msgr2=0x7f81b00a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 -- 172.21.15.50:0/706350891 shutdown_connections 2022-05-02T09:39:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.564+0000 7f81b559d700 1 -- 172.21.15.50:0/706350891 wait complete. 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.566+0000 7f81b559d700 1 Processor -- start 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.566+0000 7f81b559d700 1 -- start start 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b00a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b00a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 0x7f81b0148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a3aa0 con 0x7f81b0139b00 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a1bf0 con 0x7f81b005cc50 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.567+0000 7f81b559d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a1eb0 con 0x7f81b0139720 2022-05-02T09:39:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81affff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b00a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81af7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b00a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 0x7f81b0148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81affff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b00a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50430/0 (socket says 172.21.15.50:50430) 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81affff700 1 -- 172.21.15.50:0/521245754 learned_addr learned my addr 172.21.15.50:0/521245754 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 -- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 msgr2=0x7f81b00a2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b00a2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 -- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 msgr2=0x7f81b00a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b00a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.568+0000 7f81b4d9c700 1 -- 172.21.15.50:0/521245754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a000b180 con 0x7f81b0139b00 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81b4d9c700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 0x7f81b0148800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f81a800c000 tx=0x7f81a8009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a80126d0 con 0x7f81b0139b00 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8012830 con 0x7f81b0139b00 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b00a30e0 con 0x7f81b0139b00 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a8012b90 con 0x7f81b0139b00 2022-05-02T09:39:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.569+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b00a1840 con 0x7f81b0139b00 2022-05-02T09:39:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.570+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f81a8022070 con 0x7f81b0139b00 2022-05-02T09:39:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.570+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b00a3f30 con 0x7f81b0139b00 2022-05-02T09:39:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.571+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f81a804a870 con 0x7f81b0139b00 2022-05-02T09:39:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.574+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f81b00a3f30 con 0x7f81b0139b00 2022-05-02T09:39:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.734+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81b00a3f30 con 0x7f81b0139b00 2022-05-02T09:39:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.735+0000 7f81ad7fa700 1 -- 172.21.15.50:0/521245754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f81b00a3f30 con 0x7f81b0139b00 2022-05-02T09:39:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:39:59.738 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:39:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.736+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 >> v1:172.21.15.50:6800/30011 conn(0x7f8190038940 legacy=0x7f819003ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.736+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 msgr2=0x7f81b0148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.736+0000 7f81b559d700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 0x7f81b0148800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f81a800c000 tx=0x7f81a8009290).stop 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 shutdown_connections 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81b0139b00 0x7f81b0148800 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81b005cc50 0x7f81b00a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 --2- 172.21.15.50:0/521245754 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f81b0139720 0x7f81b00a2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 >> 172.21.15.50:0/521245754 conn(0x7f81b00669d0 msgr2=0x7f81b01373c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 shutdown_connections 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:39:59.737+0000 7f81b559d700 1 -- 172.21.15.50:0/521245754 wait complete. 2022-05-02T09:39:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:40:00.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:00.065 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:40:01.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:40:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.280+0000 7f19ead9d700 1 Processor -- start 2022-05-02T09:40:01.283 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.280+0000 7f19ead9d700 1 -- start start 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.281+0000 7f19ead9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e41327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.281+0000 7f19ead9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19e4095430 0x7f19e41330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.281+0000 7f19ead9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e40a7270 con 0x7f19e4136140 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.281+0000 7f19ead9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e4094760 con 0x7f19e4095430 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.281+0000 7f19ead9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4135ea0 con 0x7f19e40a6e90 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e9d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e41327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19e4095430 0x7f19e41330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19ea59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19e4136140 0x7f19e41365a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52236/0 (socket says 172.21.15.50:52236) 2022-05-02T09:40:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19ea59c700 1 -- 172.21.15.50:0/2234682408 learned_addr learned my addr 172.21.15.50:0/2234682408 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 -- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 msgr2=0x7f19e41327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e41327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 -- 172.21.15.50:0/2234682408 >> v1:172.21.15.50:6789/0 conn(0x7f19e4136140 legacy=0x7f19e41365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 -- 172.21.15.50:0/2234682408 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e41335a0 con 0x7f19e4095430 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e9d9b700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e41327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.282+0000 7f19e959a700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e41330b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f19d4002f70 tx=0x7f19d4006df0).ready entity=mon.0 client_cookie=91a648ca315411a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19e8d99700 1 -- 172.21.15.50:0/2234682408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d400d570 con 0x7f19e4095430 2022-05-02T09:40:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19e8d99700 1 -- 172.21.15.50:0/2234682408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4000e90 con 0x7f19e4095430 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19e8d99700 1 -- 172.21.15.50:0/2234682408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d400d8c0 con 0x7f19e4095430 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 -- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 msgr2=0x7f19e41330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e41330b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f19d4002f70 tx=0x7f19d4006df0).stop 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 -- 172.21.15.50:0/2234682408 shutdown_connections 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e41327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2234682408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e41330b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 -- 172.21.15.50:0/2234682408 >> 172.21.15.50:0/2234682408 conn(0x7f19e405b8a0 msgr2=0x7f19e405bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 -- 172.21.15.50:0/2234682408 shutdown_connections 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.283+0000 7f19ead9d700 1 -- 172.21.15.50:0/2234682408 wait complete. 2022-05-02T09:40:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.285+0000 7f19ead9d700 1 Processor -- start 2022-05-02T09:40:01.289 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.285+0000 7f19ead9d700 1 -- start start 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.285+0000 7f19ead9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.285+0000 7f19ead9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e40669b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19ead9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19e4136140 0x7f19e4066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19ead9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e40626f0 con 0x7f19e4095430 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19ead9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4062a00 con 0x7f19e4136140 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19ead9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4066320 con 0x7f19e40a6e90 2022-05-02T09:40:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35862/0 (socket says 172.21.15.50:35862) 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 -- 172.21.15.50:0/2935139356 learned_addr learned my addr 172.21.15.50:0/2935139356 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e959a700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e40669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19ea59c700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19e4136140 0x7f19e4066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 -- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 msgr2=0x7f19e40669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e40669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 -- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19e4136140 msgr2=0x7f19e4066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19e4136140 0x7f19e4066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.286+0000 7f19e9d9b700 1 -- 172.21.15.50:0/2935139356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e000d410 con 0x7f19e4095430 2022-05-02T09:40:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19e9d9b700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f19e000e000 tx=0x7f19e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e000bb20 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e000bc80 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e0010440 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d400b180 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.287+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e4067410 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.288+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f19e00105a0 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.288+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e406c070 con 0x7f19e4095430 2022-05-02T09:40:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.289+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f19e004aee0 con 0x7f19e4095430 2022-05-02T09:40:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.292+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f19e0033940 con 0x7f19e4095430 2022-05-02T09:40:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.451+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19e40a7560 con 0x7f19e4095430 2022-05-02T09:40:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.452+0000 7f19d2ffd700 1 -- 172.21.15.50:0/2935139356 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f19e0033530 con 0x7f19e4095430 2022-05-02T09:40:01.507 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:01.507 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 >> v1:172.21.15.50:6800/30011 conn(0x7f19c4038940 legacy=0x7f19c403ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 msgr2=0x7f19e4063760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f19e000e000 tx=0x7f19e0008040).stop 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 shutdown_connections 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19e4136140 0x7f19e4066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e4095430 0x7f19e4063760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 --2- 172.21.15.50:0/2935139356 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f19e40a6e90 0x7f19e40669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 >> 172.21.15.50:0/2935139356 conn(0x7f19e405b8a0 msgr2=0x7f19e40a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 shutdown_connections 2022-05-02T09:40:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:01.454+0000 7f19ead9d700 1 -- 172.21.15.50:0/2935139356 wait complete. 2022-05-02T09:40:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:40:01.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:01.812 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:40:02.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:40:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.026+0000 7fc02d39d700 1 Processor -- start 2022-05-02T09:40:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.026+0000 7fc02d39d700 1 -- start start 2022-05-02T09:40:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 0x7fc028136e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc028095880 con 0x7fc028096080 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc028095b60 con 0x7fc028133940 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc028137300 con 0x7fc028094350 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc0277fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc027fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 0x7fc028136e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc0277fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49752/0 (socket says 172.21.15.50:49752) 2022-05-02T09:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc0277fe700 1 -- 172.21.15.50:0/2111063142 learned_addr learned my addr 172.21.15.50:0/2111063142 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc02cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50436/0 (socket says 172.21.15.50:50436) 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.027+0000 7fc027fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 0x7fc028136e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35864/0 (socket says 172.21.15.50:35864) 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 -- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 msgr2=0x7fc028133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 -- 172.21.15.50:0/2111063142 >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 msgr2=0x7fc028136e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 --2- 172.21.15.50:0/2111063142 >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 0x7fc028136e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 -- 172.21.15.50:0/2111063142 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280a8b10 con 0x7fc028094350 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc02cb9c700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc0277fe700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc01c002f70 tx=0x7fc01c006eb0).ready entity=mon.2 client_cookie=e4aa62b649c7674c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc026ffd700 1 -- 172.21.15.50:0/2111063142 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c00d570 con 0x7fc028094350 2022-05-02T09:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc026ffd700 1 -- 172.21.15.50:0/2111063142 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c000e90 con 0x7fc028094350 2022-05-02T09:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.028+0000 7fc026ffd700 1 -- 172.21.15.50:0/2111063142 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c00d900 con 0x7fc028094350 2022-05-02T09:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 -- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 msgr2=0x7fc0280a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc01c002f70 tx=0x7fc01c006eb0).stop 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 -- 172.21.15.50:0/2111063142 shutdown_connections 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028133940 0x7fc028133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2111063142 >> v2:172.21.15.50:3300/0 conn(0x7fc028096080 0x7fc028136e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2111063142 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028094350 0x7fc0280a7ce0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 -- 172.21.15.50:0/2111063142 >> 172.21.15.50:0/2111063142 conn(0x7fc02805b8a0 msgr2=0x7fc02805bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 -- 172.21.15.50:0/2111063142 shutdown_connections 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.029+0000 7fc02d39d700 1 -- 172.21.15.50:0/2111063142 wait complete. 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.031+0000 7fc02d39d700 1 Processor -- start 2022-05-02T09:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.031+0000 7fc02d39d700 1 -- start start 2022-05-02T09:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028096080 0x7fc02809bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc028133940 0x7fc0280651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02809c1c0 con 0x7fc028133940 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280681a0 con 0x7fc028094350 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.032+0000 7fc02d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc02809cf70 con 0x7fc028096080 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50438/0 (socket says 172.21.15.50:50438) 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 -- 172.21.15.50:0/2734413786 learned_addr learned my addr 172.21.15.50:0/2734413786 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc0277fe700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028096080 0x7fc02809bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc02cb9c700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc028133940 0x7fc0280651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 -- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028096080 msgr2=0x7fc02809bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028096080 0x7fc02809bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 -- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc028133940 msgr2=0x7fc0280651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc028133940 0x7fc0280651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 -- 172.21.15.50:0/2734413786 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009470 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.033+0000 7fc027fff700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc01800c000 tx=0x7fc018006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.034+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc018010780 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.034+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0180108e0 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.034+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc018010c40 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.034+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c00b1e0 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.034+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0280a5530 con 0x7fc028094350 2022-05-02T09:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.035+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fc01801c460 con 0x7fc028094350 2022-05-02T09:40:03.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.035+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0280a5380 con 0x7fc028094350 2022-05-02T09:40:03.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.035+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc01804a850 con 0x7fc028094350 2022-05-02T09:40:03.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.039+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc018033230 con 0x7fc028094350 2022-05-02T09:40:03.202 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.199+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02806c070 con 0x7fc028094350 2022-05-02T09:40:03.202 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.199+0000 7fc0257fa700 1 -- 172.21.15.50:0/2734413786 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fc01802a090 con 0x7fc028094350 2022-05-02T09:40:03.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:03.202 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:40:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 >> v1:172.21.15.50:6800/30011 conn(0x7fc008038940 legacy=0x7fc00803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 msgr2=0x7fc028067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc01800c000 tx=0x7fc018006df0).stop 2022-05-02T09:40:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 shutdown_connections 2022-05-02T09:40:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc028133940 0x7fc0280651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc028094350 0x7fc028067310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 --2- 172.21.15.50:0/2734413786 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc028096080 0x7fc02809bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.201+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 >> 172.21.15.50:0/2734413786 conn(0x7fc02805b8a0 msgr2=0x7fc0281331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.202+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 shutdown_connections 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:03.202+0000 7fc02d39d700 1 -- 172.21.15.50:0/2734413786 wait complete. 2022-05-02T09:40:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:40:03.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:03.531 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:40:04.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:40:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.746+0000 7fe87f7ff700 1 Processor -- start 2022-05-02T09:40:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.746+0000 7fe87f7ff700 1 -- start start 2022-05-02T09:40:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87f7ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe87809c4e0 0x7fe878139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe8781406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87f7ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87809bd40 con 0x7fe878139a10 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87f7ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe878061e10 con 0x7fe87809c4e0 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87809b0f0 con 0x7fe87809b8d0 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.747+0000 7fe87d59b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe878139a10 0x7fe878061440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52238/0 (socket says 172.21.15.50:52238) 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87d59b700 1 -- 172.21.15.50:0/338122052 learned_addr learned my addr 172.21.15.50:0/338122052 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87dd9c700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe8781406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 --2- 172.21.15.50:0/338122052 >> v2:172.21.15.50:3300/0 conn(0x7fe87809c4e0 0x7fe878139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe867fff700 1 -- 172.21.15.50:0/338122052 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68583678 0 0) 0x7fe87809bd40 con 0x7fe878139a10 2022-05-02T09:40:04.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe867fff700 1 -- 172.21.15.50:0/338122052 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860003260 con 0x7fe878139a10 2022-05-02T09:40:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 -- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 msgr2=0x7fe8781406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe8781406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 -- 172.21.15.50:0/338122052 >> v1:172.21.15.50:6789/0 conn(0x7fe878139a10 legacy=0x7fe878061440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 -- 172.21.15.50:0/338122052 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878139480 con 0x7fe87809c4e0 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87dd9c700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe8781406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.748+0000 7fe87cd9a700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe87809c4e0 0x7fe878139df0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe868002f70 tx=0x7fe868006d90).ready entity=mon.0 client_cookie=8dd46d34334b8a0e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe867fff700 1 -- 172.21.15.50:0/338122052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86800e590 con 0x7fe87809c4e0 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe867fff700 1 -- 172.21.15.50:0/338122052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868000e90 con 0x7fe87809c4e0 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe867fff700 1 -- 172.21.15.50:0/338122052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86800e8e0 con 0x7fe87809c4e0 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 -- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe87809c4e0 msgr2=0x7fe878139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe87809c4e0 0x7fe878139df0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe868002f70 tx=0x7fe868006d90).stop 2022-05-02T09:40:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 -- 172.21.15.50:0/338122052 shutdown_connections 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe8781406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/338122052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe87809c4e0 0x7fe878139df0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 -- 172.21.15.50:0/338122052 >> 172.21.15.50:0/338122052 conn(0x7fe8780aa090 msgr2=0x7fe8780aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.749+0000 7fe87f7ff700 1 -- 172.21.15.50:0/338122052 shutdown_connections 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.750+0000 7fe87f7ff700 1 -- 172.21.15.50:0/338122052 wait complete. 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.751+0000 7fe87f7ff700 1 Processor -- start 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.751+0000 7fe87f7ff700 1 -- start start 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe878139a10 0x7fe878148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8781490a0 0x7fe878149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878149a40 con 0x7fe8781490a0 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780995b0 con 0x7fe87809b8d0 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780965e0 con 0x7fe878139a10 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87d59b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87d59b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50442/0 (socket says 172.21.15.50:50442) 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87d59b700 1 -- 172.21.15.50:0/3669246290 learned_addr learned my addr 172.21.15.50:0/3669246290 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87cd9a700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe878139a10 0x7fe878148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.752+0000 7fe87dd9c700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8781490a0 0x7fe878149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 -- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe878139a10 msgr2=0x7fe878148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe878139a10 0x7fe878148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 -- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8781490a0 msgr2=0x7fe878149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8781490a0 0x7fe878149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 -- 172.21.15.50:0/3669246290 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009470 con 0x7fe87809b8d0 2022-05-02T09:40:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87d59b700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe878097510 tx=0x7fe874007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8740070d0 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874007230 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86800b120 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe874005610 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.753+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe878097150 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.755+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878097f10 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.755+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fe874010070 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.756+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe874049910 con 0x7fe87809b8d0 2022-05-02T09:40:04.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.759+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe878097f10 con 0x7fe87809b8d0 2022-05-02T09:40:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.914+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe878098970 con 0x7fe87809b8d0 2022-05-02T09:40:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.915+0000 7fe8667fc700 1 -- 172.21.15.50:0/3669246290 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fe878098970 con 0x7fe87809b8d0 2022-05-02T09:40:04.918 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:04.918 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:40:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.916+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 >> v1:172.21.15.50:6800/30011 conn(0x7fe8580389d0 legacy=0x7fe85803ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.916+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 msgr2=0x7fe878098c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.916+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe878097510 tx=0x7fe874007ad0).stop 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 shutdown_connections 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8781490a0 0x7fe878149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe87809b8d0 0x7fe878098c30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 --2- 172.21.15.50:0/3669246290 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe878139a10 0x7fe878148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 >> 172.21.15.50:0/3669246290 conn(0x7fe8780aa090 msgr2=0x7fe878133180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 shutdown_connections 2022-05-02T09:40:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:04.917+0000 7fe87f7ff700 1 -- 172.21.15.50:0/3669246290 wait complete. 2022-05-02T09:40:04.921 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:40:05.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:05.245 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:40:06.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:40:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.457+0000 7f7d109fe700 1 Processor -- start 2022-05-02T09:40:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.457+0000 7f7d109fe700 1 -- start start 2022-05-02T09:40:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.458+0000 7f7d109fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.458+0000 7f7d109fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0c139b00 0x7f7d0c05d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.458+0000 7f7d109fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c139010 con 0x7f7d0c05cc50 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d109fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c1392d0 con 0x7f7d0c139b00 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d109fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0a7c50 con 0x7f7d0c139720 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0ad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0c139b00 0x7f7d0c05d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0c139b00 0x7f7d0c05d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35872/0 (socket says 172.21.15.50:35872) 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 -- 172.21.15.50:0/3674153821 learned_addr learned my addr 172.21.15.50:0/3674153821 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0ad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50444/0 (socket says 172.21.15.50:50444) 2022-05-02T09:40:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0b59e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d0c05cc50 0x7f7d0c05fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52240/0 (socket says 172.21.15.50:52240) 2022-05-02T09:40:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 -- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 msgr2=0x7f7d0c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 --2- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 -- 172.21.15.50:0/3674153821 >> v1:172.21.15.50:6789/0 conn(0x7f7d0c05cc50 legacy=0x7f7d0c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.459+0000 7f7d0a59c700 1 -- 172.21.15.50:0/3674153821 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0a95d0 con 0x7f7d0c139b00 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d0a59c700 1 --2- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c139b00 0x7f7d0c05d7d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d00006eb0).ready entity=mon.0 client_cookie=4d947508e4cec5c7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d09d9b700 1 -- 172.21.15.50:0/3674153821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0000d570 con 0x7f7d0c139b00 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d09d9b700 1 -- 172.21.15.50:0/3674153821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00000e90 con 0x7f7d0c139b00 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d09d9b700 1 -- 172.21.15.50:0/3674153821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0000d900 con 0x7f7d0c139b00 2022-05-02T09:40:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d109fe700 1 -- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c139b00 msgr2=0x7f7d0c05d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.460+0000 7f7d109fe700 1 --2- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c139b00 0x7f7d0c05d7d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d00006eb0).stop 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 -- 172.21.15.50:0/3674153821 shutdown_connections 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 --2- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 --2- 172.21.15.50:0/3674153821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c139b00 0x7f7d0c05d7d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 -- 172.21.15.50:0/3674153821 >> 172.21.15.50:0/3674153821 conn(0x7f7d0c0669d0 msgr2=0x7f7d0c0a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 -- 172.21.15.50:0/3674153821 shutdown_connections 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.461+0000 7f7d109fe700 1 -- 172.21.15.50:0/3674153821 wait complete. 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.462+0000 7f7d109fe700 1 Processor -- start 2022-05-02T09:40:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.462+0000 7f7d109fe700 1 -- start start 2022-05-02T09:40:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 0x7f7d0c063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c131170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7d0c139b00 0x7f7d0c131660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c12cf70 con 0x7f7d0c05cc50 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0648c0 con 0x7f7d0c139720 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d109fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c064b00 con 0x7f7d0c139b00 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d0ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 0x7f7d0c063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d0a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d0ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 0x7f7d0c063cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35874/0 (socket says 172.21.15.50:35874) 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d0ad9d700 1 -- 172.21.15.50:0/1533009807 learned_addr learned my addr 172.21.15.50:0/1533009807 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.463+0000 7f7d0b59e700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7d0c139b00 0x7f7d0c131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 -- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7d0c139b00 msgr2=0x7f7d0c131660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7d0c139b00 0x7f7d0c131660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 -- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 msgr2=0x7f7d0c063cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 0x7f7d0c063cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 -- 172.21.15.50:0/1533009807 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0000b1e0 con 0x7f7d0c139720 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d0a59c700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c131170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d00015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d000116e0 con 0x7f7d0c139720 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00011840 con 0x7f7d0c139720 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d00011ba0 con 0x7f7d0c139720 2022-05-02T09:40:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c062fd0 con 0x7f7d0c139720 2022-05-02T09:40:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.464+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1321f0 con 0x7f7d0c139720 2022-05-02T09:40:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.465+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f7d0001a040 con 0x7f7d0c139720 2022-05-02T09:40:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.466+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c057990 con 0x7f7d0c139720 2022-05-02T09:40:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.466+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7d0004b230 con 0x7f7d0c139720 2022-05-02T09:40:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.469+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7d000087d0 con 0x7f7d0c139720 2022-05-02T09:40:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.626+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d0c061b40 con 0x7f7d0c139720 2022-05-02T09:40:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.627+0000 7f7cfbfff700 1 -- 172.21.15.50:0/1533009807 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7d00023020 con 0x7f7d0c139720 2022-05-02T09:40:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:06.630 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:39:45.619714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4257,"mds_1":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"b","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.50:6818/3538936663","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3538936663}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:40:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 >> v1:172.21.15.50:6800/30011 conn(0x7f7ce8038940 legacy=0x7f7ce803ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 msgr2=0x7f7d0c131170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c131170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d00015000).stop 2022-05-02T09:40:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 shutdown_connections 2022-05-02T09:40:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7d0c139b00 0x7f7d0c131660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c05cc50 0x7f7d0c063cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 --2- 172.21.15.50:0/1533009807 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d0c139720 0x7f7d0c131170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 >> 172.21.15.50:0/1533009807 conn(0x7f7d0c0669d0 msgr2=0x7f7d0c0a6970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 shutdown_connections 2022-05-02T09:40:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:06.629+0000 7f7d109fe700 1 -- 172.21.15.50:0/1533009807 wait complete. 2022-05-02T09:40:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2022-05-02T09:40:06.748 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2022-05-02T09:40:06.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:39:45.619714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4257, 'mds_1': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.50:6818/3538936663', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6818', 'nonce': 3538936663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:06.957 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4254:up:stopping 2022-05-02T09:40:07.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:40:08.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.170+0000 7fa3a9f9d700 1 Processor -- start 2022-05-02T09:40:08.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.170+0000 7fa3a9f9d700 1 -- start start 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a9f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a9f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 0x7fa3a41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a9f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a405d360 con 0x7fa3a4139720 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a9f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a4139010 con 0x7fa3a405d7d0 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a9f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41392d0 con 0x7fa3a4139b00 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a979c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 0x7fa3a41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a8f9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3a4139720 0x7fa3a405cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52246/0 (socket says 172.21.15.50:52246) 2022-05-02T09:40:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.171+0000 7fa3a8f9b700 1 -- 172.21.15.50:0/3558277917 learned_addr learned my addr 172.21.15.50:0/3558277917 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a37fe700 1 -- 172.21.15.50:0/3558277917 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109732222 0 0) 0x7fa3a405d360 con 0x7fa3a4139720 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3558277917 >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 msgr2=0x7fa3a41402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a3fff700 1 --2- 172.21.15.50:0/3558277917 >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 0x7fa3a41402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3558277917 >> v1:172.21.15.50:6789/0 conn(0x7fa3a4139720 legacy=0x7fa3a405cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3558277917 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40a7c50 con 0x7fa3a4139b00 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a979c700 1 --2- 172.21.15.50:0/3558277917 >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 0x7fa3a41402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a3fff700 1 --2- 172.21.15.50:0/3558277917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a405b8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa390002f70 tx=0x7fa390006df0).ready entity=mon.2 client_cookie=23ed9df97a86fec6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a37fe700 1 -- 172.21.15.50:0/3558277917 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa39000d570 con 0x7fa3a4139b00 2022-05-02T09:40:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a37fe700 1 -- 172.21.15.50:0/3558277917 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390000e90 con 0x7fa3a4139b00 2022-05-02T09:40:08.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.172+0000 7fa3a37fe700 1 -- 172.21.15.50:0/3558277917 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa39000d8c0 con 0x7fa3a4139b00 2022-05-02T09:40:08.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3558277917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 msgr2=0x7fa3a405b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3558277917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a405b8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa390002f70 tx=0x7fa390006df0).stop 2022-05-02T09:40:08.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3558277917 shutdown_connections 2022-05-02T09:40:08.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3558277917 >> v2:172.21.15.50:3300/0 conn(0x7fa3a405d7d0 0x7fa3a41402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.180 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3558277917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a405b8a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3558277917 >> 172.21.15.50:0/3558277917 conn(0x7fa3a40669d0 msgr2=0x7fa3a40a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3558277917 shutdown_connections 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.173+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3558277917 wait complete. 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.174+0000 7fa3a9f9d700 1 Processor -- start 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 -- start start 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 0x7fa3a40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40a47d0 con 0x7fa3a4139720 2022-05-02T09:40:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40a5640 con 0x7fa3a405d7d0 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.175+0000 7fa3a9f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40a3510 con 0x7fa3a4139b00 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a8f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 0x7fa3a40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35882/0 (socket says 172.21.15.50:35882) 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3532652370 learned_addr learned my addr 172.21.15.50:0/3532652370 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a979c700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 msgr2=0x7fa3a4148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a4148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 msgr2=0x7fa3a40a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 0x7fa3a40a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a3fff700 1 -- 172.21.15.50:0/3532652370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009470 con 0x7fa3a4139720 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.176+0000 7fa3a8f9b700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 0x7fa3a40a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a3fff700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa390002f70 tx=0x7fa390014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa390016070 con 0x7fa3a4139720 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3900139c0 con 0x7fa3a4139720 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa390013d20 con 0x7fa3a4139720 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39000b180 con 0x7fa3a4139720 2022-05-02T09:40:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.177+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40a1e60 con 0x7fa3a4139720 2022-05-02T09:40:08.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.178+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7fa39000f030 con 0x7fa3a4139720 2022-05-02T09:40:08.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.178+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a40a5780 con 0x7fa3a4139720 2022-05-02T09:40:08.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.179+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa39004b100 con 0x7fa3a4139720 2022-05-02T09:40:08.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.182+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa3a40a5780 con 0x7fa3a4139720 2022-05-02T09:40:08.344 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.342+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a40a5780 con 0x7fa3a4139720 2022-05-02T09:40:08.344 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.342+0000 7fa3a1ffb700 1 -- 172.21.15.50:0/3532652370 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2017 (secure 0 0 0) 0x7fa3a40a5780 con 0x7fa3a4139720 2022-05-02T09:40:08.345 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:08.345 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:40:06.686111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 >> v1:172.21.15.50:6800/30011 conn(0x7fa3840389d0 legacy=0x7fa38403ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 msgr2=0x7fa3a40a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa390002f70 tx=0x7fa390014000).stop 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 shutdown_connections 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa3a4139b00 0x7fa3a4148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a405d7d0 0x7fa3a40a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 --2- 172.21.15.50:0/3532652370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4139720 0x7fa3a40a2ac0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 >> 172.21.15.50:0/3532652370 conn(0x7fa3a40669d0 msgr2=0x7fa3a405cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 shutdown_connections 2022-05-02T09:40:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.344+0000 7fa3a9f9d700 1 -- 172.21.15.50:0/3532652370 wait complete. 2022-05-02T09:40:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 14 2022-05-02T09:40:08.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:40:06.686111+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4257}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:40:08.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-05-02T09:40:08.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-05-02T09:40:08.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.878+0000 7f43335ff700 1 Processor -- start 2022-05-02T09:40:08.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.879+0000 7f43335ff700 1 -- start start 2022-05-02T09:40:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.879+0000 7f43335ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f432c1367e0 0x7f432c0a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.879+0000 7f43335ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c066a80 0x7f432c1379d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f43335ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0671b0 con 0x7f432c136bc0 2022-05-02T09:40:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f43335ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0a4810 con 0x7f432c1367e0 2022-05-02T09:40:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f43335ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0a4570 con 0x7f432c066a80 2022-05-02T09:40:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f4330b9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f432c136bc0 0x7f432c1372c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52248/0 (socket says 172.21.15.50:52248) 2022-05-02T09:40:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f4330b9a700 1 -- 172.21.15.50:0/833849164 learned_addr learned my addr 172.21.15.50:0/833849164 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:40:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f433139b700 1 --2- 172.21.15.50:0/833849164 >> v2:172.21.15.50:3300/0 conn(0x7f432c1367e0 0x7f432c0a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f4331b9c700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c066a80 0x7f432c1379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f431bfff700 1 -- 172.21.15.50:0/833849164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968259777 0 0) 0x7f432c0671b0 con 0x7f432c136bc0 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f433139b700 1 -- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c066a80 msgr2=0x7f432c1379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f433139b700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c066a80 0x7f432c1379d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.880+0000 7f433139b700 1 -- 172.21.15.50:0/833849164 >> v1:172.21.15.50:6789/0 conn(0x7f432c136bc0 legacy=0x7f432c1372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.881+0000 7f433139b700 1 -- 172.21.15.50:0/833849164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0a42c0 con 0x7f432c1367e0 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.881+0000 7f433139b700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c1367e0 0x7f432c0a3dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4328002f70 tx=0x7f4328006df0).ready entity=mon.0 client_cookie=d5950e3d836301d9 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.881+0000 7f431bfff700 1 -- 172.21.15.50:0/833849164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432800d570 con 0x7f432c1367e0 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.881+0000 7f431bfff700 1 -- 172.21.15.50:0/833849164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328000e90 con 0x7f432c1367e0 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.881+0000 7f431bfff700 1 -- 172.21.15.50:0/833849164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432800d8c0 con 0x7f432c1367e0 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 -- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c1367e0 msgr2=0x7f432c0a3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c1367e0 0x7f432c0a3dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4328002f70 tx=0x7f4328006df0).stop 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 -- 172.21.15.50:0/833849164 shutdown_connections 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c066a80 0x7f432c1379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 --2- 172.21.15.50:0/833849164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c1367e0 0x7f432c0a3dd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 -- 172.21.15.50:0/833849164 >> 172.21.15.50:0/833849164 conn(0x7f432c0a8690 msgr2=0x7f432c0a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 -- 172.21.15.50:0/833849164 shutdown_connections 2022-05-02T09:40:08.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.882+0000 7f43335ff700 1 -- 172.21.15.50:0/833849164 wait complete. 2022-05-02T09:40:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.883+0000 7f43335ff700 1 Processor -- start 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.883+0000 7f43335ff700 1 -- start start 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 0x7f432c0a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f432c1367e0 0x7f432c145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c091f40 con 0x7f432c066a80 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1467e0 con 0x7f432c1367e0 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f43335ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432c145910 con 0x7f432c136bc0 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f432c1367e0 0x7f432c145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.884+0000 7f4331b9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 0x7f432c0a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49768/0 (socket says 172.21.15.50:49768) 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 -- 172.21.15.50:0/1535597820 learned_addr learned my addr 172.21.15.50:0/1535597820 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 -- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f432c1367e0 msgr2=0x7f432c145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f432c1367e0 0x7f432c145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 -- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 msgr2=0x7f432c0a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 0x7f432c0a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 -- 172.21.15.50:0/1535597820 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432800b180 con 0x7f432c136bc0 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f433139b700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 0x7f432c0a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.885+0000 7f4331b9c700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4324006e00 tx=0x7f43240091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.886+0000 7f431a7fc700 1 -- 172.21.15.50:0/1535597820 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432400c640 con 0x7f432c136bc0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.886+0000 7f431a7fc700 1 -- 172.21.15.50:0/1535597820 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400c7a0 con 0x7f432c136bc0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.886+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c0929e0 con 0x7f432c136bc0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.886+0000 7f431a7fc700 1 -- 172.21.15.50:0/1535597820 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432400cb00 con 0x7f432c136bc0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.886+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c146540 con 0x7f432c136bc0 2022-05-02T09:40:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.887+0000 7f431a7fc700 1 -- 172.21.15.50:0/1535597820 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 4) v1 ==== 41713+0+0 (secure 0 0 0) 0x7f432400cc60 con 0x7f432c136bc0 2022-05-02T09:40:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.888+0000 7f431a7fc700 1 -- 172.21.15.50:0/1535597820 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f432404a610 con 0x7f432c136bc0 2022-05-02T09:40:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.892+0000 7f434adf2b80 1 Processor -- start 2022-05-02T09:40:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.892+0000 7f434adf2b80 1 -- start start 2022-05-02T09:40:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.892+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.892+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19196a0 con 0x55c3c195cbf0 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c18ea5b0 con 0x55c3c19cf870 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c3c18fda10 con 0x55c3c19a1fd0 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f4331b9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50456/0 (socket says 172.21.15.50:50456) 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f4331b9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49770/0 (socket says 172.21.15.50:49770) 2022-05-02T09:40:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f4330b9a700 1 -- 172.21.15.50:0/2599280975 learned_addr learned my addr 172.21.15.50:0/2599280975 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 -- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 msgr2=0x55c3c19a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 -- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 msgr2=0x55c3c19a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.893+0000 7f433139b700 1 -- 172.21.15.50:0/2599280975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c18ed6b0 con 0x55c3c195cbf0 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f4330b9a700 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f4331b9c700 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f433139b700 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19a3a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x55c3c19c6df0 tx=0x7f4328014000).ready entity=mon.0 client_cookie=74d65e4f783bb192 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f43335ff700 1 -- 172.21.15.50:0/2599280975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4328016070 con 0x55c3c195cbf0 2022-05-02T09:40:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f43335ff700 1 -- 172.21.15.50:0/2599280975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328017040 con 0x55c3c195cbf0 2022-05-02T09:40:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.894+0000 7f43335ff700 1 -- 172.21.15.50:0/2599280975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4328013470 con 0x55c3c195cbf0 2022-05-02T09:40:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 -- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 msgr2=0x55c3c19a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19a3a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x55c3c19c6df0 tx=0x7f4328014000).stop 2022-05-02T09:40:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 -- 172.21.15.50:0/2599280975 shutdown_connections 2022-05-02T09:40:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c19a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19a3a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2599280975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c19a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 -- 172.21.15.50:0/2599280975 >> 172.21.15.50:0/2599280975 conn(0x55c3c1972cb0 msgr2=0x55c3c1971cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 -- 172.21.15.50:0/2599280975 shutdown_connections 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.895+0000 7f434adf2b80 1 -- 172.21.15.50:0/2599280975 wait complete. 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.896+0000 7f434adf2b80 1 -- start start 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.896+0000 7f434adf2b80 1 Processor -- start 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.897+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.897+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c18de4f0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c18ce510 con 0x55c3c195cbf0 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19c3bf0 con 0x55c3c19cf870 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f434adf2b80 10 client.0 ll_register_callbacks cb 0x55c3c18f3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50458/0 (socket says 172.21.15.50:50458) 2022-05-02T09:40:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f433139b700 1 -- 172.21.15.50:0/2745851123 learned_addr learned my addr 172.21.15.50:0/2745851123 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4331b9c700 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 -- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 msgr2=0x55c3c19c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 -- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 msgr2=0x55c3c19cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.898+0000 7f4330b9a700 1 -- 172.21.15.50:0/2745851123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c146540 con 0x55c3c19a1fd0 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f4330b9a700 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19c2b40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x55c3c19cb460 tx=0x7f431c007c00).ready entity=mon.0 client_cookie=9162bff60ec8bfc8 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f4307fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f431c012ed0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f431c015440 con 0x55c3c19a1fd0 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3c1929de0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f431c015600 con 0x55c3c19a1fd0 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f434adf2b80 10 client.4914 fetch_fsmap learned FSMap version 14 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.899+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f431c007240 con 0x55c3c19a1fd0 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3c1929de0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 14) v1 ==== 1181+0+0 (secure 0 0 0) 0x7f431c015c70 con 0x55c3c19a1fd0 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f434adf2b80 10 client.4914 fetch_fsmap finished waiting for FSMap version 14 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f434adf2b80 10 client.4914 resolve_mds: resolved ID 'c' to GID 4257 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f434adf2b80 20 client.4914 populate_metadata read hostname 'smithi050' 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f434adf2b80 4 client.4914 mds_command: new command op to 4257 tid=0[{"prefix": "get_command_descriptions"}] 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3c18f3e00 con 0x55c3c19c9370 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.900+0000 7f4307fff700 10 client.4914 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:40:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f4307fff700 1 -- 172.21.15.50:0/2745851123 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55c3c18f3e00 con 0x55c3c19c9370 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f4307fff700 10 client.4914 handle_command_reply: tid=0 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 client.4914 shutdown 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 msgr2=0x55c3c19c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19c2b40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x55c3c19cb460 tx=0x7f431c007c00).stop 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 shutdown_connections 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.901+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f434adf2b80 1 --2- 172.21.15.50:0/2745851123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19c2b40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 >> 172.21.15.50:0/2745851123 conn(0x55c3c1972cb0 msgr2=0x55c3c19a2430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f4307fff700 0 client.4914 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:40:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 shutdown_connections 2022-05-02T09:40:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f434adf2b80 1 -- 172.21.15.50:0/2745851123 wait complete. 2022-05-02T09:40:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.902+0000 7f434adf2b80 20 client.4914 trim_cache size 0 max 16384 2022-05-02T09:40:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.919+0000 7f434adf2b80 1 Processor -- start 2022-05-02T09:40:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.919+0000 7f434adf2b80 1 -- start start 2022-05-02T09:40:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19a3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19c5d30 con 0x55c3c19a1fd0 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19c3d40 con 0x55c3c195cbf0 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19a3ff0 con 0x55c3c19cf870 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35892/0 (socket says 172.21.15.50:35892) 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f4330b9a700 1 -- 172.21.15.50:0/1966094951 learned_addr learned my addr 172.21.15.50:0/1966094951 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f4331b9c700 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.920+0000 7f433139b700 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 -- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 msgr2=0x55c3c19a3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19a3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 -- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 msgr2=0x55c3c19cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 -- 172.21.15.50:0/1966094951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c19cb2d0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f4330b9a700 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x55c3c19c6db0 tx=0x7f431c01f000).ready entity=mon.0 client_cookie=669c3e0b1ceb41ad server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f43123ff700 1 -- 172.21.15.50:0/1966094951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f431c012980 con 0x55c3c19a1fd0 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f43123ff700 1 -- 172.21.15.50:0/1966094951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c01f450 con 0x55c3c19a1fd0 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.921+0000 7f43123ff700 1 -- 172.21.15.50:0/1966094951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f431c01f940 con 0x55c3c19a1fd0 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 -- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 msgr2=0x55c3c19a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x55c3c19c6db0 tx=0x7f431c01f000).stop 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 -- 172.21.15.50:0/1966094951 shutdown_connections 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19cf870 0x55c3c19a3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c195cbf0 0x55c3c19cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 --2- 172.21.15.50:0/1966094951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c19a1fd0 0x55c3c19a5940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 -- 172.21.15.50:0/1966094951 >> 172.21.15.50:0/1966094951 conn(0x55c3c1972cb0 msgr2=0x55c3c19a23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 -- 172.21.15.50:0/1966094951 shutdown_connections 2022-05-02T09:40:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.922+0000 7f434adf2b80 1 -- 172.21.15.50:0/1966094951 wait complete. 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.923+0000 7f434adf2b80 1 -- start start 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.923+0000 7f434adf2b80 1 Processor -- start 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c1a32f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-05-02T09:40:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19cc460 con 0x55c3c195cbf0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19c2ff0 con 0x55c3c19cf870 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c3c19e2c10 con 0x55c3c19a1fd0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f434adf2b80 10 client.0 ll_register_callbacks cb 0x55c3c19a58a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f4331b9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c1a32f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f4330b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49776/0 (socket says 172.21.15.50:49776) 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f433139b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35894/0 (socket says 172.21.15.50:35894) 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.924+0000 7f4330b9a700 1 -- 172.21.15.50:0/3446119679 learned_addr learned my addr 172.21.15.50:0/3446119679 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:40:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 -- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 msgr2=0x55c3c1a32f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c1a32f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 -- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 msgr2=0x55c3c19cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 -- 172.21.15.50:0/3446119679 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c007240 con 0x55c3c19a1fd0 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4331b9c700 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c1a32f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f4330b9a700 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x55c3c19c6db0 tx=0x7f431c029000).ready entity=mon.2 client_cookie=1df0201f87d9c7f7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f43113fd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3302/0 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f431c036070 con 0x55c3c19a1fd0 2022-05-02T09:40:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mon.2 v2:172.21.15.50:3302/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f431c000e40 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4328017040 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f431c012980 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f434adf2b80 10 client.4664 fetch_fsmap learned FSMap version 14 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.925+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f432c0a42c0 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mon.2 v2:172.21.15.50:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328017040 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mon.2 v2:172.21.15.50:3302/0 5 ==== fsmap(e 14) v1 ==== 1181+0+0 (secure 0 0 0) 0x7f431c015950 con 0x55c3c19a1fd0 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f434adf2b80 10 client.4664 fetch_fsmap finished waiting for FSMap version 14 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f434adf2b80 10 client.4664 resolve_mds: resolved ID 'c' to GID 4257 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f434adf2b80 20 client.4664 populate_metadata read hostname 'smithi050' 2022-05-02T09:40:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f434adf2b80 4 client.4664 mds_command: new command op to 4257 tid=0[{"prefix": "status"}] 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3c18ec140 con 0x55c3c19e3410 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.926+0000 7f43113fd700 10 client.4664 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f43113fd700 1 -- 172.21.15.50:0/3446119679 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 2323360220) 0x55c3c18ec140 con 0x55c3c19e3410 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f43113fd700 10 client.4664 handle_command_reply: tid=0 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 client.4664 shutdown 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 msgr2=0x55c3c1a32a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x55c3c19c6db0 tx=0x7f431c029000).stop 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 shutdown_connections 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55c3c19cf870 0x55c3c1a32f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3c195cbf0 0x55c3c19cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f43113fd700 0 client.4664 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 --2- 172.21.15.50:0/3446119679 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x55c3c19a1fd0 0x55c3c1a32a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 >> 172.21.15.50:0/3446119679 conn(0x55c3c1972cb0 msgr2=0x55c3c19cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 shutdown_connections 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 1 -- 172.21.15.50:0/3446119679 wait complete. 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.927+0000 7f434adf2b80 20 client.4664 trim_cache size 0 max 16384 2022-05-02T09:40:08.938 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "7c52b71c-589c-4ac2-936d-4a721101e437", 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4257, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 57.623643567000002, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 14, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 20, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 20, 2022-05-02T09:40:08.939 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 68.103186546000003 2022-05-02T09:40:08.940 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 >> v1:172.21.15.50:6800/30011 conn(0x7f430c038a00 legacy=0x7f430c03aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 msgr2=0x7f432c148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4324006e00 tx=0x7f43240091d0).stop 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 shutdown_connections 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f432c136bc0 0x7f432c148e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c066a80 0x7f432c0a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 --2- 172.21.15.50:0/1535597820 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f432c1367e0 0x7f432c145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 >> 172.21.15.50:0/1535597820 conn(0x7f432c0a8690 msgr2=0x7f432c05b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:40:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.928+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 shutdown_connections 2022-05-02T09:40:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:40:08.929+0000 7f43335ff700 1 -- 172.21.15.50:0/1535597820 wait complete. 2022-05-02T09:40:08.954 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:40:08.970 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2022-05-02T09:40:08.970 INFO:teuthology.run_tasks:Running task install.upgrade... 2022-05-02T09:40:08.994 INFO:teuthology.task.install:project ceph config {'mon.a': None, 'mon.b': None} overrides {'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'} 2022-05-02T09:40:08.994 WARNING:teuthology.task.install:remote ubuntu@smithi050.front.sepia.ceph.com came up twice (role mon.b) 2022-05-02T09:40:08.994 INFO:teuthology.task.install:remote ubuntu@smithi050.front.sepia.ceph.com config {'flavor': 'default', 'sha1': 'b82312f270e887c49dafe642c4ee39a73bc7d8fa'} 2022-05-02T09:40:08.994 INFO:teuthology.task.install:extra packages: [] 2022-05-02T09:40:08.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:40:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:40:09.119 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:40:09.128 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-05-02T09:40:09.128 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2022-05-02T09:40:09.128 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2022-05-02T09:40:09.197 INFO:teuthology.orchestra.run.smithi050.stdout:15.2.16-0.el8 2022-05-02T09:40:09.197 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.16-0.el8 2022-05-02T09:40:09.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:40:09.318 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:40:09.322 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:40:09.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:40:09.480 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.16-0.el8 to 17.0.0-11888.gb82312f2 2022-05-02T09:40:09.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:40:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:40:09.607 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:40:09.607 INFO:teuthology.task.install.rpm:Host smithi050 is: centos 8 x86_64 2022-05-02T09:40:09.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:40:09.760 INFO:teuthology.task.install.rpm:Repo base URL: https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220428-204527/b82312f270e887c49dafe642c4ee39a73bc7d8fa/centos/8/flavors/default/ 2022-05-02T09:40:09.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/yum.repos.d/ceph.repo 2022-05-02T09:40:10.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220428-204527/b82312f270e887c49dafe642c4ee39a73bc7d8fa/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220428-204527/b82312f270e887c49dafe642c4ee39a73bc7d8fa/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220428-204527/b82312f270e887c49dafe642c4ee39a73bc7d8fa/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-02T09:40:10.176 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2022-05-02T09:40:10.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-02T09:40:10.264 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b82312f270e887c49dafe642c4ee39a73bc7d8fa/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-02T09:40:10.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-02T09:40:10.442 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-02T09:40:10.498 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2022-05-02T09:40:10.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2022-05-02T09:40:10.930 INFO:teuthology.orchestra.run.smithi050.stdout:65 files removed 2022-05-02T09:40:10.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2022-05-02T09:40:12.326 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 98 kB/s | 78 kB 00:00 2022-05-02T09:40:12.935 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 16 kB/s | 9.1 kB 00:00 2022-05-02T09:40:13.360 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 3.6 kB/s | 1.4 kB 00:00 2022-05-02T09:40:13.971 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 37 MB/s | 21 MB 00:00 2022-05-02T09:40:18.904 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Base 39 MB/s | 22 MB 00:00 2022-05-02T09:40:22.579 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 166 kB/s | 18 kB 00:00 2022-05-02T09:40:23.123 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - PowerTools 11 MB/s | 4.5 MB 00:00 2022-05-02T09:40:24.298 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2022-05-02T09:40:25.465 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:01 2022-05-02T09:40:28.832 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 400 kB/s | 24 kB 00:00 2022-05-02T09:40:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:Package cephadm available, but not installed. 2022-05-02T09:40:31.878 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: cephadm 2022-05-02T09:40:31.883 INFO:teuthology.orchestra.run.smithi050.stderr:Package ceph-mgr-dashboard available, but not installed. 2022-05-02T09:40:31.884 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-dashboard 2022-05-02T09:40:31.884 INFO:teuthology.orchestra.run.smithi050.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2022-05-02T09:40:31.885 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-diskprediction-local 2022-05-02T09:40:31.885 INFO:teuthology.orchestra.run.smithi050.stderr:Package ceph-mgr-rook available, but not installed. 2022-05-02T09:40:31.885 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-rook 2022-05-02T09:40:31.886 INFO:teuthology.orchestra.run.smithi050.stderr:Package ceph-mgr-cephadm available, but not installed. 2022-05-02T09:40:31.886 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-cephadm 2022-05-02T09:40:31.888 INFO:teuthology.orchestra.run.smithi050.stderr:Package ceph-volume available, but not installed. 2022-05-02T09:40:31.888 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-volume 2022-05-02T09:40:32.014 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2022-05-02T09:40:32.019 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 6.5 k 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 5.3 M 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 23 M 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 882 k 2022-05-02T09:40:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 169 k 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 2.3 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 1.5 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11888.gb82312f2.el8 ceph-noarch 228 k 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 3.9 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 17 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 16 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 24 k 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 52 M 2022-05-02T09:40:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 25 k 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 796 k 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 125 k 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 3.4 M 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 484 k 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 3.9 M 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 5.3 M 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 45 k 2022-05-02T09:40:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 106 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 178 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 367 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 346 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 109 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 93 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 3.8 M 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 174 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:17.0.0-11888.gb82312f2.el8 ceph 170 k 2022-05-02T09:40:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 29 Packages 2022-05-02T09:40:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:40:32.025 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 144 M 2022-05-02T09:40:32.025 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2022-05-02T09:40:32.159 INFO:teuthology.orchestra.run.smithi050.stdout:(1/31): ceph-17.0.0-11888.gb82312f2.el8.x86_64. 49 kB/s | 6.5 kB 00:00 2022-05-02T09:40:32.243 INFO:teuthology.orchestra.run.smithi050.stdout:(2/31): libcephsqlite-17.0.0-11888.gb82312f2.el 792 kB/s | 170 kB 00:00 2022-05-02T09:40:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:(3/31): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2022-05-02T09:40:32.685 INFO:teuthology.orchestra.run.smithi050.stdout:(4/31): ceph-base-17.0.0-11888.gb82312f2.el8.x8 10 MB/s | 5.3 MB 00:00 2022-05-02T09:40:32.760 INFO:teuthology.orchestra.run.smithi050.stdout:(5/31): ceph-immutable-object-cache-17.0.0-1188 2.2 MB/s | 169 kB 00:00 2022-05-02T09:40:33.019 INFO:teuthology.orchestra.run.smithi050.stdout:(6/31): ceph-mds-17.0.0-11888.gb82312f2.el8.x86 8.9 MB/s | 2.3 MB 00:00 2022-05-02T09:40:33.094 INFO:teuthology.orchestra.run.smithi050.stdout:(7/31): ceph-fuse-17.0.0-11888.gb82312f2.el8.x8 1.3 MB/s | 882 kB 00:00 2022-05-02T09:40:33.194 INFO:teuthology.orchestra.run.smithi050.stdout:(8/31): ceph-mgr-17.0.0-11888.gb82312f2.el8.x86 8.8 MB/s | 1.5 MB 00:00 2022-05-02T09:40:34.129 INFO:teuthology.orchestra.run.smithi050.stdout:(9/31): ceph-common-17.0.0-11888.gb82312f2.el8. 12 MB/s | 23 MB 00:01 2022-05-02T09:40:34.212 INFO:teuthology.orchestra.run.smithi050.stdout:(10/31): ceph-mon-17.0.0-11888.gb82312f2.el8.x8 3.5 MB/s | 3.9 MB 00:01 2022-05-02T09:40:34.287 INFO:teuthology.orchestra.run.smithi050.stdout:(11/31): ceph-selinux-17.0.0-11888.gb82312f2.el 325 kB/s | 24 kB 00:00 2022-05-02T09:40:35.121 INFO:teuthology.orchestra.run.smithi050.stdout:(12/31): ceph-osd-17.0.0-11888.gb82312f2.el8.x8 8.8 MB/s | 17 MB 00:01 2022-05-02T09:40:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:(13/31): libcephfs-devel-17.0.0-11888.gb82312f2 375 kB/s | 25 kB 00:00 2022-05-02T09:40:35.338 INFO:teuthology.orchestra.run.smithi050.stdout:(14/31): libcephfs2-17.0.0-11888.gb82312f2.el8. 5.2 MB/s | 796 kB 00:00 2022-05-02T09:40:35.421 INFO:teuthology.orchestra.run.smithi050.stdout:(15/31): librados-devel-17.0.0-11888.gb82312f2. 1.5 MB/s | 125 kB 00:00 2022-05-02T09:40:35.705 INFO:teuthology.orchestra.run.smithi050.stdout:(16/31): ceph-radosgw-17.0.0-11888.gb82312f2.el 10 MB/s | 16 MB 00:01 2022-05-02T09:40:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:(17/31): libradosstriper1-17.0.0-11888.gb82312f 5.7 MB/s | 484 kB 00:00 2022-05-02T09:40:35.872 INFO:teuthology.orchestra.run.smithi050.stdout:(18/31): librados2-17.0.0-11888.gb82312f2.el8.x 7.7 MB/s | 3.4 MB 00:00 2022-05-02T09:40:36.223 INFO:teuthology.orchestra.run.smithi050.stdout:(19/31): librbd1-17.0.0-11888.gb82312f2.el8.x86 8.9 MB/s | 3.9 MB 00:00 2022-05-02T09:40:36.290 INFO:teuthology.orchestra.run.smithi050.stdout:(20/31): python3-ceph-argparse-17.0.0-11888.gb8 675 kB/s | 45 kB 00:00 2022-05-02T09:40:36.357 INFO:teuthology.orchestra.run.smithi050.stdout:(21/31): python3-ceph-common-17.0.0-11888.gb823 1.6 MB/s | 106 kB 00:00 2022-05-02T09:40:36.423 INFO:teuthology.orchestra.run.smithi050.stdout:(22/31): python3-cephfs-17.0.0-11888.gb82312f2. 2.6 MB/s | 178 kB 00:00 2022-05-02T09:40:36.499 INFO:teuthology.orchestra.run.smithi050.stdout:(23/31): librgw2-17.0.0-11888.gb82312f2.el8.x86 8.5 MB/s | 5.3 MB 00:00 2022-05-02T09:40:36.541 INFO:teuthology.orchestra.run.smithi050.stdout:(24/31): python3-rados-17.0.0-11888.gb82312f2.e 3.1 MB/s | 367 kB 00:00 2022-05-02T09:40:36.574 INFO:teuthology.orchestra.run.smithi050.stdout:(25/31): python3-rbd-17.0.0-11888.gb82312f2.el8 4.5 MB/s | 346 kB 00:00 2022-05-02T09:40:36.600 INFO:teuthology.orchestra.run.smithi050.stdout:(26/31): python3-rgw-17.0.0-11888.gb82312f2.el8 1.8 MB/s | 109 kB 00:00 2022-05-02T09:40:36.625 INFO:teuthology.orchestra.run.smithi050.stdout:(27/31): rbd-fuse-17.0.0-11888.gb82312f2.el8.x8 1.8 MB/s | 93 kB 00:00 2022-05-02T09:40:36.709 INFO:teuthology.orchestra.run.smithi050.stdout:(28/31): rbd-nbd-17.0.0-11888.gb82312f2.el8.x86 2.0 MB/s | 174 kB 00:00 2022-05-02T09:40:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:(29/31): ceph-mgr-modules-core-17.0.0-11888.gb8 2.7 MB/s | 228 kB 00:00 2022-05-02T09:40:36.976 INFO:teuthology.orchestra.run.smithi050.stdout:(30/31): rbd-mirror-17.0.0-11888.gb82312f2.el8. 10 MB/s | 3.8 MB 00:00 2022-05-02T09:40:40.118 INFO:teuthology.orchestra.run.smithi050.stdout:(31/31): ceph-test-17.0.0-11888.gb82312f2.el8.x 9.0 MB/s | 52 MB 00:05 2022-05-02T09:40:40.121 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2022-05-02T09:40:40.121 INFO:teuthology.orchestra.run.smithi050.stdout:Total 18 MB/s | 144 MB 00:08 2022-05-02T09:40:40.122 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2022-05-02T09:40:40.193 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2022-05-02T09:40:40.222 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2022-05-02T09:40:40.964 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2022-05-02T09:40:40.967 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2022-05-02T09:40:43.014 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2022-05-02T09:40:43.505 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:17.0.0-11888.gb82312f2.el8.x86_64 1/1 2022-05-02T09:40:43.770 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:17.0.0-11888.gb82312f2.el8.x86_64 1/60 2022-05-02T09:40:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:17.0.0-11888.gb82312f2.el8.x86_64 1/60 2022-05-02T09:40:44.620 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:17.0.0-11888.gb82312f2.el8.x86_64 2/60 2022-05-02T09:40:44.799 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:17.0.0-11888.gb82312f2.el8.x86_64 2/60 2022-05-02T09:40:45.012 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libcephfs2-2:17.0.0-11888.gb82312f2.el8.x86_64 3/60 2022-05-02T09:40:45.154 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:17.0.0-11888.gb82312f2.el8.x86_64 3/60 2022-05-02T09:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-rados-2:17.0.0-11888.gb82312f2.el8.x86_64 4/60 2022-05-02T09:40:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2022-05-02T09:40:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librgw2-2:17.0.0-11888.gb82312f2.el8.x86_64 6/60 2022-05-02T09:40:46.839 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:17.0.0-11888.gb82312f2.el8.x86_64 6/60 2022-05-02T09:40:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:17.0.0-11888.gb82312f2.el8.x86_64 7/60 2022-05-02T09:40:47.204 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11888.gb82312f2.el8.x86_64 7/60 2022-05-02T09:40:47.428 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libradosstriper1-2:17.0.0-11888.gb82312f2.el8.x86_ 8/60 2022-05-02T09:40:47.537 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11888.gb82312f2.el8.x86_ 8/60 2022-05-02T09:40:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-ceph-argparse-2:17.0.0-11888.gb82312f2.el8 9/60 2022-05-02T09:40:48.211 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-cephfs-2:17.0.0-11888.gb82312f2.el8.x86_64 10/60 2022-05-02T09:40:48.457 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-rgw-2:17.0.0-11888.gb82312f2.el8.x86_64 11/60 2022-05-02T09:40:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-rbd-2:17.0.0-11888.gb82312f2.el8.x86_64 12/60 2022-05-02T09:40:49.103 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados-devel-2:17.0.0-11888.gb82312f2.el8.x86_64 13/60 2022-05-02T09:40:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-mgr-modules-core-2:17.0.0-11888.gb82312f2.el8 14/60 2022-05-02T09:40:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : python3-ceph-common-2:17.0.0-11888.gb82312f2.el8.x 15/60 2022-05-02T09:40:52.428 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 16/60 2022-05-02T09:40:52.824 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 16/60 2022-05-02T09:40:53.666 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 16/60 2022-05-02T09:40:53.981 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-base-2:17.0.0-11888.gb82312f2.el8.x86_64 17/60 2022-05-02T09:40:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:17.0.0-11888.gb82312f2.el8.x86_64 17/60 2022-05-02T09:40:54.269 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-selinux-2:17.0.0-11888.gb82312f2.el8.x86_64 18/60 2022-05-02T09:41:14.802 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11888.gb82312f2.el8.x86_64 18/60 2022-05-02T09:41:15.084 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-mds-2:17.0.0-11888.gb82312f2.el8.x86_64 19/60 2022-05-02T09:41:15.293 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:17.0.0-11888.gb82312f2.el8.x86_64 19/60 2022-05-02T09:41:15.692 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-mgr-2:17.0.0-11888.gb82312f2.el8.x86_64 20/60 2022-05-02T09:41:16.258 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11888.gb82312f2.el8.x86_64 20/60 2022-05-02T09:41:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-mon-2:17.0.0-11888.gb82312f2.el8.x86_64 21/60 2022-05-02T09:41:18.415 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:17.0.0-11888.gb82312f2.el8.x86_64 21/60 2022-05-02T09:41:18.736 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-osd-2:17.0.0-11888.gb82312f2.el8.x86_64 22/60 2022-05-02T09:41:18.781 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:17.0.0-11888.gb82312f2.el8.x86_64 22/60 2022-05-02T09:41:20.808 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-2:17.0.0-11888.gb82312f2.el8.x86_64 23/60 2022-05-02T09:41:21.177 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-radosgw-2:17.0.0-11888.gb82312f2.el8.x86_64 24/60 2022-05-02T09:41:21.311 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11888.gb82312f2.el8.x86_64 24/60 2022-05-02T09:41:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-immutable-object-cache-2:17.0.0-11888.gb82312 25/60 2022-05-02T09:41:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11888.gb82312 25/60 2022-05-02T09:41:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : rbd-mirror-2:17.0.0-11888.gb82312f2.el8.x86_64 26/60 2022-05-02T09:41:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11888.gb82312f2.el8.x86_64 26/60 2022-05-02T09:41:29.195 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-test-2:17.0.0-11888.gb82312f2.el8.x86_64 27/60 2022-05-02T09:41:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libcephfs-devel-2:17.0.0-11888.gb82312f2.el8.x86_6 28/60 2022-05-02T09:41:29.587 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : rbd-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 29/60 2022-05-02T09:41:29.913 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : rbd-nbd-2:17.0.0-11888.gb82312f2.el8.x86_64 30/60 2022-05-02T09:41:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : ceph-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 31/60 2022-05-02T09:41:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-2:15.2.16-0.el8.x86_64 32/60 2022-05-02T09:41:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-test-2:15.2.16-0.el8.x86_64 33/60 2022-05-02T09:41:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.2.16-0.el8.x86_64 34/60 2022-05-02T09:41:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-radosgw-2:15.2.16-0.el8.x86_64 34/60 2022-05-02T09:41:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.2.16-0.el8.x86_64 34/60 2022-05-02T09:41:31.041 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : rbd-nbd-2:15.2.16-0.el8.x86_64 35/60 2022-05-02T09:41:31.075 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:15.2.16-0.el8.x86_64 36/60 2022-05-02T09:41:31.075 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : rbd-mirror-2:15.2.16-0.el8.x86_64 36/60 2022-05-02T09:41:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:15.2.16-0.el8.x86_64 36/60 2022-05-02T09:41:31.443 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : rbd-fuse-2:15.2.16-0.el8.x86_64 37/60 2022-05-02T09:41:31.477 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 38/60 2022-05-02T09:41:31.478 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 38/60 2022-05-02T09:41:31.674 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 38/60 2022-05-02T09:41:31.807 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libcephfs-devel-2:15.2.16-0.el8.x86_64 39/60 2022-05-02T09:41:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados-devel-2:15.2.16-0.el8.x86_64 40/60 2022-05-02T09:41:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.2.16-0.el8.x86_64 41/60 2022-05-02T09:41:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-mgr-2:15.2.16-0.el8.x86_64 41/60 2022-05-02T09:41:32.219 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.2.16-0.el8.x86_64 41/60 2022-05-02T09:41:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.2.16-0.el8.x86_64 42/60 2022-05-02T09:41:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-osd-2:15.2.16-0.el8.x86_64 42/60 2022-05-02T09:41:32.808 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.2.16-0.el8.x86_64 42/60 2022-05-02T09:41:32.841 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.2.16-0.el8.x86_64 43/60 2022-05-02T09:41:32.841 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-mds-2:15.2.16-0.el8.x86_64 43/60 2022-05-02T09:41:33.075 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.2.16-0.el8.x86_64 43/60 2022-05-02T09:41:33.107 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.2.16-0.el8.x86_64 44/60 2022-05-02T09:41:33.108 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-mon-2:15.2.16-0.el8.x86_64 44/60 2022-05-02T09:41:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.2.16-0.el8.x86_64 44/60 2022-05-02T09:41:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-selinux-2:15.2.16-0.el8.x86_64 45/60 2022-05-02T09:41:33.492 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:15.2.16-0.el8.x86_64 45/60 2022-05-02T09:41:33.560 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.2.16-0.el8.x86_64 46/60 2022-05-02T09:41:33.560 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-base-2:15.2.16-0.el8.x86_64 46/60 2022-05-02T09:41:33.897 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.2.16-0.el8.x86_64 46/60 2022-05-02T09:41:33.898 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-common-2:15.2.16-0.el8.x86_64 47/60 2022-05-02T09:41:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.2.16-0.el8.x86_64 47/60 2022-05-02T09:41:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libradosstriper1-2:15.2.16-0.el8.x86_64 48/60 2022-05-02T09:41:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:15.2.16-0.el8.x86_64 48/60 2022-05-02T09:41:34.590 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-cephfs-2:15.2.16-0.el8.x86_64 49/60 2022-05-02T09:41:34.748 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-rbd-2:15.2.16-0.el8.x86_64 50/60 2022-05-02T09:41:34.749 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:15.2.16-0.el8.x86_64 51/60 2022-05-02T09:41:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:15.2.16-0.el8.x86_64 51/60 2022-05-02T09:41:35.265 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-rgw-2:15.2.16-0.el8.x86_64 52/60 2022-05-02T09:41:35.265 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librgw2-2:15.2.16-0.el8.x86_64 53/60 2022-05-02T09:41:35.515 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:15.2.16-0.el8.x86_64 53/60 2022-05-02T09:41:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-rados-2:15.2.16-0.el8.x86_64 54/60 2022-05-02T09:41:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libcephfs2-2:15.2.16-0.el8.x86_64 55/60 2022-05-02T09:41:35.975 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:15.2.16-0.el8.x86_64 55/60 2022-05-02T09:41:36.131 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-fuse-2:15.2.16-0.el8.x86_64 56/60 2022-05-02T09:41:36.284 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 57/60 2022-05-02T09:41:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : python3-ceph-common-2:15.2.16-0.el8.x86_64 58/60 2022-05-02T09:41:36.618 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 59/60 2022-05-02T09:41:36.618 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:15.2.16-0.el8.x86_64 60/60 2022-05-02T09:41:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:15.2.16-0.el8.x86_64 60/60 2022-05-02T09:41:37.155 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-05-02T09:41:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:17.0.0-11888.gb82312f2.el8.x86_64 1/60 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:17.0.0-11888.gb82312f2.el8.x86_64 3/60 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:15.2.16-0.el8.x86_64 4/60 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:17.0.0-11888.gb82312f2.el8.x86_64 5/60 2022-05-02T09:41:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:15.2.16-0.el8.x86_64 6/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 7/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:15.2.16-0.el8.x86_64 8/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 9/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:15.2.16-0.el8.x86_64 10/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11888.gb82312 11/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:15.2.16-0.el8.x86_64 12/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:17.0.0-11888.gb82312f2.el8.x86_64 13/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:15.2.16-0.el8.x86_64 14/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:17.0.0-11888.gb82312f2.el8.x86_64 15/60 2022-05-02T09:41:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:15.2.16-0.el8.x86_64 16/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:17.0.0-11888.gb82312f2.el8.x86_64 17/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:15.2.16-0.el8.x86_64 18/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:17.0.0-11888.gb82312f2.el8.x86_64 19/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:15.2.16-0.el8.x86_64 20/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:17.0.0-11888.gb82312f2.el8.x86_64 21/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:15.2.16-0.el8.x86_64 22/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:17.0.0-11888.gb82312f2.el8.x86_64 23/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:15.2.16-0.el8.x86_64 24/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:17.0.0-11888.gb82312f2.el8.x86_64 25/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:15.2.16-0.el8.x86_64 26/60 2022-05-02T09:41:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:17.0.0-11888.gb82312f2.el8.x86_6 27/60 2022-05-02T09:41:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:15.2.16-0.el8.x86_64 28/60 2022-05-02T09:41:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:17.0.0-11888.gb82312f2.el8.x86_64 29/60 2022-05-02T09:41:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:15.2.16-0.el8.x86_64 30/60 2022-05-02T09:41:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:17.0.0-11888.gb82312f2.el8.x86_64 31/60 2022-05-02T09:41:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:15.2.16-0.el8.x86_64 32/60 2022-05-02T09:41:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:17.0.0-11888.gb82312f2.el8.x86_64 33/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:15.2.16-0.el8.x86_64 34/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:17.0.0-11888.gb82312f2.el8.x86_ 35/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:15.2.16-0.el8.x86_64 36/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:17.0.0-11888.gb82312f2.el8.x86_64 37/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:15.2.16-0.el8.x86_64 38/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:17.0.0-11888.gb82312f2.el8.x86_64 39/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:15.2.16-0.el8.x86_64 40/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11888.gb82312f2.el8 41/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:15.2.16-0.el8.x86_64 42/60 2022-05-02T09:41:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:17.0.0-11888.gb82312f2.el8.x 43/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:15.2.16-0.el8.x86_64 44/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:17.0.0-11888.gb82312f2.el8.x86_64 45/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:15.2.16-0.el8.x86_64 46/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:17.0.0-11888.gb82312f2.el8.x86_64 47/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:15.2.16-0.el8.x86_64 48/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:17.0.0-11888.gb82312f2.el8.x86_64 49/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:15.2.16-0.el8.x86_64 50/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:17.0.0-11888.gb82312f2.el8.x86_64 51/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:15.2.16-0.el8.x86_64 52/60 2022-05-02T09:41:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 53/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:15.2.16-0.el8.x86_64 54/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:17.0.0-11888.gb82312f2.el8.x86_64 55/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:15.2.16-0.el8.x86_64 56/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:17.0.0-11888.gb82312f2.el8.x86_64 57/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:15.2.16-0.el8.x86_64 58/60 2022-05-02T09:41:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11888.gb82312f2.el8 59/60 2022-05-02T09:41:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:15.2.16-0.el8.noarch 60/60 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:17.0.0-11888.gb82312f2.el8.noarch 2022-05-02T09:41:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:17.0.0-11888.gb82312f2.el8.x86_64 2022-05-02T09:41:39.158 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2022-05-02T09:41:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:17.0.0-11888.gb82312f2.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2022-05-02T09:41:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:39.158 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2022-05-02T09:41:39.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2022-05-02T09:41:39.553 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2022-05-02T09:41:39.558 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-05-02T09:41:39.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b82312f270e887c49dafe642c4ee39a73bc7d8fa 2022-05-02T09:41:39.710 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-02T09:41:39.780 INFO:teuthology.orchestra.run.smithi050.stdout:17.0.0-11888.gb82312f2.el8 2022-05-02T09:41:39.780 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11888.gb82312f2.el8 2022-05-02T09:41:39.780 INFO:teuthology.task.install:The correct ceph version 17.0.0-11888.gb82312f2 is installed. 2022-05-02T09:41:39.780 INFO:teuthology.run_tasks:Running task print... 2022-05-02T09:41:39.794 INFO:teuthology.task.print:**** done install.upgrade both hosts 2022-05-02T09:41:39.795 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-05-02T09:41:39.841 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-05-02T09:41:39.841 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:39.873 INFO:tasks.ceph.mon.a:Stopped 2022-05-02T09:41:39.873 INFO:tasks.ceph.mon.a:Restarting daemon 2022-05-02T09:41:39.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-05-02T09:41:39.918 INFO:tasks.ceph.mon.a:Started 2022-05-02T09:41:39.919 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-05-02T09:41:39.919 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:39.955 INFO:tasks.ceph.mon.b:Stopped 2022-05-02T09:41:39.955 INFO:tasks.ceph.mon.b:Restarting daemon 2022-05-02T09:41:39.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-05-02T09:41:40.001 INFO:tasks.ceph.mon.b:Started 2022-05-02T09:41:40.002 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-05-02T09:41:40.002 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:40.042 INFO:tasks.ceph.mon.c:Stopped 2022-05-02T09:41:40.042 INFO:tasks.ceph.mon.c:Restarting daemon 2022-05-02T09:41:40.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-05-02T09:41:40.088 INFO:tasks.ceph.mon.c:Started 2022-05-02T09:41:40.088 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-05-02T09:41:40.089 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:40.173 INFO:tasks.ceph.mgr.x:Stopped 2022-05-02T09:41:40.173 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-05-02T09:41:40.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-05-02T09:41:40.178 INFO:tasks.ceph.mgr.x:Started 2022-05-02T09:41:40.179 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2022-05-02T09:41:40.179 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:40.268 INFO:tasks.ceph.mgr.y:Stopped 2022-05-02T09:41:40.268 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-05-02T09:41:40.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-05-02T09:41:40.274 INFO:tasks.ceph.mgr.y:Started 2022-05-02T09:41:40.274 INFO:teuthology.run_tasks:Running task ceph.healthy... 2022-05-02T09:41:40.289 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-05-02T09:41:40.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-05-02T09:41:40.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-05-02T09:41:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.540+0000 7f63e61ff700 1 Processor -- start 2022-05-02T09:41:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.540+0000 7f63e61ff700 1 -- start start 2022-05-02T09:41:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.541+0000 7f63e61ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.541+0000 7f63e61ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.541+0000 7f63e61ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00a9970 con 0x7f63e00636c0 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.541+0000 7f63e61ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00a7f60 con 0x7f63e00a7ae0 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.541+0000 7f63e61ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a9b20 con 0x7f63e00b4c80 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63df7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f63e00636c0 0x7f63e013aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52308/0 (socket says 172.21.15.50:52308) 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63deffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 learned_addr learned my addr 172.21.15.50:0/2248116899 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-05-02T09:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.542+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:41:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-05-02T09:41:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:41:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:41:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:40.743+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:41:41.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-05-02T09:41:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.144+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:41:41.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.946+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-02T09:41:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63dffff700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:41.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:41.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:41.947+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:41:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63e013b1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63e013b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63e0148200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63e0148200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 >> v1:172.21.15.50:6789/0 conn(0x7f63e00636c0 legacy=0x7f63e013aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.542+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a7f60 con 0x7f63c0003570 2022-05-02T09:41:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.543+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.543+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:41:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.543+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.543+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.543+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-05-02T09:41:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.744+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.744+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:41:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.744+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.744+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:43.744+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-05-02T09:41:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.145+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.145+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:41:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.145+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.145+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.145+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-05-02T09:41:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.947+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.947+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-02T09:41:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.947+0000 7f63df7fe700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-02T09:41:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.947+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-02T09:41:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:44.947+0000 7f63df7fe700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-05-02T09:41:45.603 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:45.601+0000 7fe919806000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-05-02T09:41:45.706 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:45.704+0000 7fe919806000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-05-02T09:41:45.926 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:45.924+0000 7fe919806000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-05-02T09:41:46.135 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.133+0000 7fe919806000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-05-02T09:41:46.232 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.230+0000 7fe919806000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-05-02T09:41:46.363 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.360+0000 7fe919806000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-05-02T09:41:46.506 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.504+0000 7fe919806000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-05-02T09:41:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.542+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 msgr2=0x7f63c00059b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:41:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.542+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63c000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dd7fa700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63c000e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e0063a90 con 0x7f63e00636c0 2022-05-02T09:41:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00a7f60 con 0x7f63e00a7ae0 2022-05-02T09:41:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dd7fa700 1 -- 172.21.15.50:0/2248116899 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a9b20 con 0x7f63e00b4c80 2022-05-02T09:41:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63c000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.543+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63c000e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 msgr2=0x7f63c000e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63c000e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 >> v1:172.21.15.50:6789/0 conn(0x7f63e00636c0 legacy=0x7f63c0008320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63deffd700 1 -- 172.21.15.50:0/2248116899 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c000f690 con 0x7f63e00b4c80 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63dffff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63c000e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.544+0000 7f63deffd700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63c000ba50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63e00a68a0 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224ce855451f4e0d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.546+0000 7f63de7fc700 1 -- 172.21.15.50:0/2248116899 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4005880 con 0x7f63e00b4c80 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.546+0000 7f63de7fc700 1 -- 172.21.15.50:0/2248116899 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4005a00 con 0x7f63e00b4c80 2022-05-02T09:41:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.546+0000 7f63de7fc700 1 -- 172.21.15.50:0/2248116899 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4005dc0 con 0x7f63e00b4c80 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 -- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 msgr2=0x7f63c000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63c000ba50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63e00a68a0 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 -- 172.21.15.50:0/2248116899 shutdown_connections 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 --2- 172.21.15.50:0/2248116899 >> v2:172.21.15.50:3300/0 conn(0x7f63e00a7ae0 0x7f63c000e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00b4c80 0x7f63c000ba50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 --2- 172.21.15.50:0/2248116899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63c0003570 0x7f63c00059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 -- 172.21.15.50:0/2248116899 >> 172.21.15.50:0/2248116899 conn(0x7f63e0069590 msgr2=0x7f63e0062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 -- 172.21.15.50:0/2248116899 shutdown_connections 2022-05-02T09:41:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.547+0000 7f63e61ff700 1 -- 172.21.15.50:0/2248116899 wait complete. 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.549+0000 7f63e61ff700 1 Processor -- start 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.549+0000 7f63e61ff700 1 -- start start 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.549+0000 7f63e61ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63e61ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 0x7f63e014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63e61ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00a7ae0 0x7f63e00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63e61ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e014e680 con 0x7f63c0003570 2022-05-02T09:41:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63e61ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00ab5c0 con 0x7f63e00636c0 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63e61ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a3cb0 con 0x7f63e00a7ae0 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35962/0 (socket says 172.21.15.50:35962) 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63df7fe700 1 -- 172.21.15.50:0/1998173399 learned_addr learned my addr 172.21.15.50:0/1998173399 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63deffd700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 0x7f63e014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.550+0000 7f63dffff700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00a7ae0 0x7f63e00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 -- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00a7ae0 msgr2=0x7f63e00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00a7ae0 0x7f63e00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 -- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 msgr2=0x7f63e00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 -- 172.21.15.50:0/1998173399 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8003ce0 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63df7fe700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63deffd700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 0x7f63e014e140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63d4006000 tx=0x7f63d4020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4027070 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4006450 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d400e040 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.551+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4006ab0 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.552+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e014dbf0 con 0x7f63e00636c0 2022-05-02T09:41:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.553+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e014dde0 con 0x7f63e00636c0 2022-05-02T09:41:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.553+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f63d401e070 con 0x7f63e00636c0 2022-05-02T09:41:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.554+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f63d404c3f0 con 0x7f63e00636c0 2022-05-02T09:41:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.554+0000 7f63df7fe700 1 -- 172.21.15.50:0/1998173399 >> v1:172.21.15.50:6800/30011 conn(0x7f63c0039650 legacy=0x7f63c003bb00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.557+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f63d40198f0 con 0x7f63e00636c0 2022-05-02T09:41:46.616 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.614+0000 7fe919806000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-05-02T09:41:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.716+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f63e004bfb0 con 0x7f63e00636c0 2022-05-02T09:41:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.718+0000 7f63c77fe700 1 -- 172.21.15.50:0/1998173399 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84510 (secure 0 0 0) 0x7f63d4031020 con 0x7f63e00636c0 2022-05-02T09:41:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 >> v1:172.21.15.50:6800/30011 conn(0x7f63c0039650 legacy=0x7f63c003bb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 msgr2=0x7f63e014e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 0x7f63e014e140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63d4006000 tx=0x7f63d4020000 comp rx=0 tx=0).stop 2022-05-02T09:41:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 shutdown_connections 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f63e00a7ae0 0x7f63e00ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63c0003570 0x7f63e00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 --2- 172.21.15.50:0/1998173399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63e00636c0 0x7f63e014e140 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 >> 172.21.15.50:0/1998173399 conn(0x7f63e0069590 msgr2=0x7f63e00b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 shutdown_connections 2022-05-02T09:41:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.720+0000 7f63e61ff700 1 -- 172.21.15.50:0/1998173399 wait complete. 2022-05-02T09:41:46.749 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6800","nonce":30011}]},"active_addr":"172.21.15.50:6800/30011","active_change":"2022-05-02T09:38:50.316449+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1390228452}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":59626694}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4112136070}]}]}} 2022-05-02T09:41:46.763 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-05-02T09:41:46.763 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-05-02T09:41:46.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:41:46.778 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.776+0000 7fe919806000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-05-02T09:41:46.816 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:46.814+0000 7f3cc1ad2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-05-02T09:41:46.900 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:46.898+0000 7fe919806000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-05-02T09:41:46.919 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:46.917+0000 7f3cc1ad2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-05-02T09:41:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.990+0000 7ff45b59e700 1 Processor -- start 2022-05-02T09:41:46.993 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.990+0000 7ff45b59e700 1 -- start start 2022-05-02T09:41:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 0x7ff45c13e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff45c0a8850 0x7ff45c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0a8f90 con 0x7ff45c0a6260 2022-05-02T09:41:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0aa2e0 con 0x7ff45c0a8850 2022-05-02T09:41:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45b59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0a5dc0 con 0x7ff45c0a9790 2022-05-02T09:41:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 0x7ff45c13e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff459d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff45c0a6260 0x7ff45c0a8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52320/0 (socket says 172.21.15.50:52320) 2022-05-02T09:41:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.991+0000 7ff459d9b700 1 -- 172.21.15.50:0/3236538564 learned_addr learned my addr 172.21.15.50:0/3236538564 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45ad9d700 1 --2- 172.21.15.50:0/3236538564 >> v2:172.21.15.50:3300/0 conn(0x7ff45c0a8850 0x7ff45c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45a59c700 1 -- 172.21.15.50:0/3236538564 >> v2:172.21.15.50:3300/0 conn(0x7ff45c0a8850 msgr2=0x7ff45c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45959a700 1 -- 172.21.15.50:0/3236538564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530078109 0 0) 0x7ff45c0a8f90 con 0x7ff45c0a6260 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45a59c700 1 --2- 172.21.15.50:0/3236538564 >> v2:172.21.15.50:3300/0 conn(0x7ff45c0a8850 0x7ff45c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45a59c700 1 -- 172.21.15.50:0/3236538564 >> v1:172.21.15.50:6789/0 conn(0x7ff45c0a6260 legacy=0x7ff45c0a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.992+0000 7ff45a59c700 1 -- 172.21.15.50:0/3236538564 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0a7ea0 con 0x7ff45c0a9790 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.993+0000 7ff45a59c700 1 --2- 172.21.15.50:0/3236538564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 0x7ff45c13e5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009760 tx=0x7ff44c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a1d6f967cd4bb server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.993+0000 7ff45959a700 1 -- 172.21.15.50:0/3236538564 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c011630 con 0x7ff45c0a9790 2022-05-02T09:41:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.993+0000 7ff45959a700 1 -- 172.21.15.50:0/3236538564 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c011790 con 0x7ff45c0a9790 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.993+0000 7ff45959a700 1 -- 172.21.15.50:0/3236538564 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c011b50 con 0x7ff45c0a9790 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 -- 172.21.15.50:0/3236538564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 msgr2=0x7ff45c13e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3236538564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 0x7ff45c13e5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009760 tx=0x7ff44c009060 comp rx=0 tx=0).stop 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 -- 172.21.15.50:0/3236538564 shutdown_connections 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3236538564 >> v2:172.21.15.50:3300/0 conn(0x7ff45c0a8850 0x7ff45c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3236538564 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a9790 0x7ff45c13e5e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 -- 172.21.15.50:0/3236538564 >> 172.21.15.50:0/3236538564 conn(0x7ff45c062df0 msgr2=0x7ff45c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 -- 172.21.15.50:0/3236538564 shutdown_connections 2022-05-02T09:41:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.994+0000 7ff45b59e700 1 -- 172.21.15.50:0/3236538564 wait complete. 2022-05-02T09:41:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.996+0000 7ff45b59e700 1 Processor -- start 2022-05-02T09:41:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.996+0000 7ff45b59e700 1 -- start start 2022-05-02T09:41:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.996+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 0x7ff45c0ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45c0a9790 0x7ff45c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ad4b0 con 0x7ff45c0a8850 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ae180 con 0x7ff45c0a9790 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45b59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ae330 con 0x7ff45c0a6260 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49850/0 (socket says 172.21.15.50:49850) 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45a59c700 1 -- 172.21.15.50:0/3061128163 learned_addr learned my addr 172.21.15.50:0/3061128163 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff459d9b700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 0x7ff45c0ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.997+0000 7ff45ad9d700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45c0a9790 0x7ff45c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 -- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45c0a9790 msgr2=0x7ff45c150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45c0a9790 0x7ff45c150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 -- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 msgr2=0x7ff45c0ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 0x7ff45c0ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 -- 172.21.15.50:0/3061128163 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0092a0 con 0x7ff45c0a6260 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff459d9b700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 0x7ff45c0ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45a59c700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009e00 tx=0x7ff44c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c009130 con 0x7ff45c0a6260 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c011900 con 0x7ff45c0a6260 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.998+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c0ad9a0 con 0x7ff45c0a6260 2022-05-02T09:41:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.999+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c01a430 con 0x7ff45c0a6260 2022-05-02T09:41:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:46.999+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c0aba40 con 0x7ff45c0a6260 2022-05-02T09:41:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.000+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7ff44c00f050 con 0x7ff45c0a6260 2022-05-02T09:41:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.000+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c04bfb0 con 0x7ff45c0a6260 2022-05-02T09:41:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.001+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff44c04c930 con 0x7ff45c0a6260 2022-05-02T09:41:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.001+0000 7ff459d9b700 1 -- 172.21.15.50:0/3061128163 >> v1:172.21.15.50:6800/30011 conn(0x7ff438038e80 legacy=0x7ff43803b330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:47.007 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:47.004+0000 7fe919806000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-05-02T09:41:47.007 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.004+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7ff44c013590 con 0x7ff45c0a6260 2022-05-02T09:41:47.131 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.128+0000 7f3cc1ad2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-05-02T09:41:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.152+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff45c13e020 con 0x7ff45c0a6260 2022-05-02T09:41:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.153+0000 7ff44a7fc700 1 -- 172.21.15.50:0/3061128163 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11296 (secure 0 0 0) 0x7ff44c015070 con 0x7ff45c0a6260 2022-05-02T09:41:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:27.562783+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.154+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 >> v1:172.21.15.50:6800/30011 conn(0x7ff438038e80 legacy=0x7ff43803b330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 msgr2=0x7ff45c1411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009e00 tx=0x7ff44c017000 comp rx=0 tx=0).stop 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 shutdown_connections 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff45c0a6260 0x7ff45c1411f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45c0a9790 0x7ff45c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 --2- 172.21.15.50:0/3061128163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff45c0a8850 0x7ff45c0ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 >> 172.21.15.50:0/3061128163 conn(0x7ff45c062df0 msgr2=0x7ff45c0a5200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 shutdown_connections 2022-05-02T09:41:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.155+0000 7ff45b59e700 1 -- 172.21.15.50:0/3061128163 wait complete. 2022-05-02T09:41:47.188 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-05-02T09:41:47.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:41:47.291 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.288+0000 7f3cc1ad2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-05-02T09:41:47.391 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.389+0000 7f3cc1ad2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-05-02T09:41:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.457+0000 7f00c959d700 1 Processor -- start 2022-05-02T09:41:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.457+0000 7f00c959d700 1 -- start start 2022-05-02T09:41:47.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.458+0000 7f00c959d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.458+0000 7f00c959d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c41415e0 0x7f00c413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.458+0000 7f00c959d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c4063a90 con 0x7f00c40a9bc0 2022-05-02T09:41:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c959d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40a8eb0 con 0x7f00c40636c0 2022-05-02T09:41:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c959d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4141a70 con 0x7f00c41415e0 2022-05-02T09:41:47.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c41415e0 0x7f00c413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50526/0 (socket says 172.21.15.50:50526) 2022-05-02T09:41:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c8d9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00c40a9bc0 0x7f00c40a4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52322/0 (socket says 172.21.15.50:52322) 2022-05-02T09:41:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c3fff700 1 -- 172.21.15.50:0/3739643467 learned_addr learned my addr 172.21.15.50:0/3739643467 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c3fff700 1 -- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c41415e0 msgr2=0x7f00c413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.459+0000 7f00c3fff700 1 --2- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c41415e0 0x7f00c413ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c3fff700 1 -- 172.21.15.50:0/3739643467 >> v1:172.21.15.50:6789/0 conn(0x7f00c40a9bc0 legacy=0x7f00c40a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c3fff700 1 -- 172.21.15.50:0/3739643467 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4141d30 con 0x7f00c40636c0 2022-05-02T09:41:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c3fff700 1 --2- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009840 tx=0x7f00b4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efb00e366051ae1 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c2ffd700 1 -- 172.21.15.50:0/3739643467 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4005a90 con 0x7f00c40636c0 2022-05-02T09:41:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c2ffd700 1 -- 172.21.15.50:0/3739643467 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4005bf0 con 0x7f00c40636c0 2022-05-02T09:41:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.460+0000 7f00c2ffd700 1 -- 172.21.15.50:0/3739643467 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4006030 con 0x7f00c40636c0 2022-05-02T09:41:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 -- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 msgr2=0x7f00c41410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 --2- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009840 tx=0x7f00b4009060 comp rx=0 tx=0).stop 2022-05-02T09:41:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 -- 172.21.15.50:0/3739643467 shutdown_connections 2022-05-02T09:41:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 --2- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40636c0 0x7f00c41410a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 --2- 172.21.15.50:0/3739643467 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c41415e0 0x7f00c413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 -- 172.21.15.50:0/3739643467 >> 172.21.15.50:0/3739643467 conn(0x7f00c4069370 msgr2=0x7f00c4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 -- 172.21.15.50:0/3739643467 shutdown_connections 2022-05-02T09:41:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.461+0000 7f00c959d700 1 -- 172.21.15.50:0/3739643467 wait complete. 2022-05-02T09:41:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.464+0000 7f00c959d700 1 Processor -- start 2022-05-02T09:41:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.464+0000 7f00c959d700 1 -- start start 2022-05-02T09:41:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c40636c0 0x7f00c40acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c41415e0 0x7f00c4150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40abf00 con 0x7f00c41415e0 2022-05-02T09:41:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b23a0 con 0x7f00c40a9bc0 2022-05-02T09:41:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c959d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b2600 con 0x7f00c40636c0 2022-05-02T09:41:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50530/0 (socket says 172.21.15.50:50530) 2022-05-02T09:41:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c37fe700 1 -- 172.21.15.50:0/3195131083 learned_addr learned my addr 172.21.15.50:0/3195131083 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.465+0000 7f00c3fff700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c40636c0 0x7f00c40acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c8d9c700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c41415e0 0x7f00c4150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 -- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c40636c0 msgr2=0x7f00c40acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c40636c0 0x7f00c40acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 -- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c41415e0 msgr2=0x7f00c4150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c41415e0 0x7f00c4150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 -- 172.21.15.50:0/3195131083 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009300 con 0x7f00c40a9bc0 2022-05-02T09:41:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.466+0000 7f00c37fe700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00b800e900 tx=0x7f00b8009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.467+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8013680 con 0x7f00c40a9bc0 2022-05-02T09:41:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.467+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80137e0 con 0x7f00c40a9bc0 2022-05-02T09:41:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.467+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8013b80 con 0x7f00c40a9bc0 2022-05-02T09:41:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.467+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c40ac1b0 con 0x7f00c40a9bc0 2022-05-02T09:41:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.467+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40b4030 con 0x7f00c40a9bc0 2022-05-02T09:41:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.468+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c40a6ca0 con 0x7f00c40a9bc0 2022-05-02T09:41:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.469+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f00b8023070 con 0x7f00c40a9bc0 2022-05-02T09:41:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.469+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f00b804b0a0 con 0x7f00c40a9bc0 2022-05-02T09:41:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.469+0000 7f00c3fff700 1 -- 172.21.15.50:0/3195131083 >> v1:172.21.15.50:6800/30011 conn(0x7f00a4038e50 legacy=0x7f00a403b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.473+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f00b8033880 con 0x7f00c40a9bc0 2022-05-02T09:41:47.528 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.525+0000 7f3cc1ad2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-05-02T09:41:47.598 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:47.595+0000 7fe919806000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-05-02T09:41:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.637+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00c404b770 con 0x7f00c40a9bc0 2022-05-02T09:41:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.637+0000 7f00abfff700 1 -- 172.21.15.50:0/3195131083 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11296 (secure 0 0 0) 0x7f00b8033490 con 0x7f00c40a9bc0 2022-05-02T09:41:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:47.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:39:27.562783+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 >> v1:172.21.15.50:6800/30011 conn(0x7f00a4038e50 legacy=0x7f00a403b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 msgr2=0x7f00c40aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00b800e900 tx=0x7f00b8009060 comp rx=0 tx=0).stop 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 shutdown_connections 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f00c40636c0 0x7f00c40acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c41415e0 0x7f00c4150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 --2- 172.21.15.50:0/3195131083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f00c40a9bc0 0x7f00c40aa890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 >> 172.21.15.50:0/3195131083 conn(0x7f00c4069370 msgr2=0x7f00c40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 shutdown_connections 2022-05-02T09:41:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.640+0000 7f00c959d700 1 -- 172.21.15.50:0/3195131083 wait complete. 2022-05-02T09:41:47.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-05-02T09:41:47.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-05-02T09:41:47.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-05-02T09:41:47.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-05-02T09:41:47.690 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.674+0000 7f3cc1ad2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-05-02T09:41:47.738 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:47.736+0000 7fe919806000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-05-02T09:41:47.830 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:47.828+0000 7f3cc1ad2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-05-02T09:41:47.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.965+0000 7fbe5d39d700 1 Processor -- start 2022-05-02T09:41:47.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.965+0000 7fbe5d39d700 1 -- start start 2022-05-02T09:41:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.967+0000 7fbe5d39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe580b3f80 0x7fbe5813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.967+0000 7fbe5d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 0x7fbe581481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.967+0000 7fbe5d39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580b4350 con 0x7fbe5813e280 2022-05-02T09:41:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.967+0000 7fbe5d39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe580a4440 con 0x7fbe580b3f80 2022-05-02T09:41:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.967+0000 7fbe5d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5813d8a0 con 0x7fbe5813b1d0 2022-05-02T09:41:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.968+0000 7fbe57fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe580b3f80 0x7fbe5813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.968+0000 7fbe5cb9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 0x7fbe581481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.968+0000 7fbe577fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe5813e280 0x7fbe5813aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52324/0 (socket says 172.21.15.50:52324) 2022-05-02T09:41:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.968+0000 7fbe577fe700 1 -- 172.21.15.50:0/69091422 learned_addr learned my addr 172.21.15.50:0/69091422 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.969+0000 7fbe5cb9c700 1 -- 172.21.15.50:0/69091422 >> v2:172.21.15.50:3300/0 conn(0x7fbe580b3f80 msgr2=0x7fbe5813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.969+0000 7fbe5cb9c700 1 --2- 172.21.15.50:0/69091422 >> v2:172.21.15.50:3300/0 conn(0x7fbe580b3f80 0x7fbe5813dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.969+0000 7fbe5cb9c700 1 -- 172.21.15.50:0/69091422 >> v1:172.21.15.50:6789/0 conn(0x7fbe5813e280 legacy=0x7fbe5813aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.969+0000 7fbe5cb9c700 1 -- 172.21.15.50:0/69091422 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5813e710 con 0x7fbe5813b1d0 2022-05-02T09:41:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.969+0000 7fbe5cb9c700 1 --2- 172.21.15.50:0/69091422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 0x7fbe581481d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e60 tx=0x7fbe50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80066b1c4ad3d53 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.970+0000 7fbe56ffd700 1 -- 172.21.15.50:0/69091422 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000e070 con 0x7fbe5813b1d0 2022-05-02T09:41:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.970+0000 7fbe56ffd700 1 -- 172.21.15.50:0/69091422 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000bbf0 con 0x7fbe5813b1d0 2022-05-02T09:41:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.970+0000 7fbe56ffd700 1 -- 172.21.15.50:0/69091422 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50012430 con 0x7fbe5813b1d0 2022-05-02T09:41:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.970+0000 7fbe5d39d700 1 -- 172.21.15.50:0/69091422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 msgr2=0x7fbe581481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.970+0000 7fbe5d39d700 1 --2- 172.21.15.50:0/69091422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 0x7fbe581481d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e60 tx=0x7fbe50009780 comp rx=0 tx=0).stop 2022-05-02T09:41:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 -- 172.21.15.50:0/69091422 shutdown_connections 2022-05-02T09:41:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 --2- 172.21.15.50:0/69091422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813b1d0 0x7fbe581481d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 --2- 172.21.15.50:0/69091422 >> v2:172.21.15.50:3300/0 conn(0x7fbe580b3f80 0x7fbe5813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 -- 172.21.15.50:0/69091422 >> 172.21.15.50:0/69091422 conn(0x7fbe58069580 msgr2=0x7fbe580674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 -- 172.21.15.50:0/69091422 shutdown_connections 2022-05-02T09:41:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.971+0000 7fbe5d39d700 1 -- 172.21.15.50:0/69091422 wait complete. 2022-05-02T09:41:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.973+0000 7fbe5d39d700 1 Processor -- start 2022-05-02T09:41:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.974+0000 7fbe5d39d700 1 -- start start 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbe580b3f80 0x7fbe581437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 0x7fbe5813fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813e280 0x7fbe58140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806ab20 con 0x7fbe5813b1d0 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806c400 con 0x7fbe5813e280 2022-05-02T09:41:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe5d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe581370d0 con 0x7fbe580b3f80 2022-05-02T09:41:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 0x7fbe5813fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 0x7fbe5813fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35976/0 (socket says 172.21.15.50:35976) 2022-05-02T09:41:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.975+0000 7fbe577fe700 1 -- 172.21.15.50:0/2064283565 learned_addr learned my addr 172.21.15.50:0/2064283565 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe57fff700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbe580b3f80 0x7fbe581437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe5cb9c700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813e280 0x7fbe58140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe577fe700 1 -- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbe580b3f80 msgr2=0x7fbe581437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe577fe700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbe580b3f80 0x7fbe581437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe577fe700 1 -- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813e280 msgr2=0x7fbe58140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe577fe700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe5813e280 0x7fbe58140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.976+0000 7fbe577fe700 1 -- 172.21.15.50:0/2064283565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50009a20 con 0x7fbe5813b1d0 2022-05-02T09:41:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.977+0000 7fbe577fe700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 0x7fbe5813fc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c490 tx=0x7fbe4c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.977+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0072e0 con 0x7fbe5813b1d0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.977+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c007440 con 0x7fbe5813b1d0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.978+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c005780 con 0x7fbe5813b1d0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.978+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5806ad00 con 0x7fbe5813b1d0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.978+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5806b3a0 con 0x7fbe5813b1d0 2022-05-02T09:41:47.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.979+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe58069980 con 0x7fbe5813b1d0 2022-05-02T09:41:47.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.980+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7fbe4c019030 con 0x7fbe5813b1d0 2022-05-02T09:41:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.981+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbe4c04a230 con 0x7fbe5813b1d0 2022-05-02T09:41:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.981+0000 7fbe57fff700 1 -- 172.21.15.50:0/2064283565 >> v1:172.21.15.50:6800/30011 conn(0x7fbe38038ea0 legacy=0x7fbe3803b350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.981+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 --> v1:172.21.15.50:6805/30635 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe38045820 con 0x7fbe38041b40 2022-05-02T09:41:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.981+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe4c04c650 con 0x7fbe5813b1d0 2022-05-02T09:41:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:47.983+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== osd.2 v1:172.21.15.50:6805/30635 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fbe38045820 con 0x7fbe38041b40 2022-05-02T09:41:48.008 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:48.006+0000 7f3cc1ad2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-05-02T09:41:48.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.012+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 --> v1:172.21.15.50:6805/30635 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe58143ce0 con 0x7fbe38041b40 2022-05-02T09:41:48.014 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.012+0000 7fbe3ffff700 1 -- 172.21.15.50:0/2064283565 <== osd.2 v1:172.21.15.50:6805/30635 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 445611385) 0x7fbe5000bd60 con 0x7fbe38041b40 2022-05-02T09:41:48.015 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.013+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 >> v1:172.21.15.50:6805/30635 conn(0x7fbe38041b40 legacy=0x7fbe38043fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.013+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 >> v1:172.21.15.50:6800/30011 conn(0x7fbe38038ea0 legacy=0x7fbe3803b350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.013+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 msgr2=0x7fbe5813fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.016 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.013+0000 7fbe5d39d700 1 --2- 172.21.15.50:0/2064283565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5813b1d0 0x7fbe5813fc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c490 tx=0x7fbe4c007df0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.014+0000 7fbe5cb9c700 1 -- 172.21.15.50:0/2064283565 reap_dead start 2022-05-02T09:41:48.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.014+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 shutdown_connections 2022-05-02T09:41:48.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.014+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 >> 172.21.15.50:0/2064283565 conn(0x7fbe58069580 msgr2=0x7fbe580a7840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.014+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 shutdown_connections 2022-05-02T09:41:48.017 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.014+0000 7fbe5d39d700 1 -- 172.21.15.50:0/2064283565 wait complete. 2022-05-02T09:41:48.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.027+0000 7ff08f59e700 1 Processor -- start 2022-05-02T09:41:48.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.027+0000 7ff08f59e700 1 -- start start 2022-05-02T09:41:48.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.028+0000 7fc29db9d700 1 Processor -- start 2022-05-02T09:41:48.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.028+0000 7fc29db9d700 1 -- start start 2022-05-02T09:41:48.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.028+0000 7ff08f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 0x7ff09013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.029+0000 7ff08f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 0x7ff09013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.029+0000 7ff08f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900b4350 con 0x7ff0900a9a80 2022-05-02T09:41:48.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.029+0000 7ff08f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900a4440 con 0x7ff0900b3f80 2022-05-02T09:41:48.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.029+0000 7ff08f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09013d8a0 con 0x7ff09013e280 2022-05-02T09:41:48.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29db9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 0x7fc29813aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29db9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc29813b000 0x7fc2981481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29db9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980b4350 con 0x7fc2980b3f80 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29db9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2980a4440 con 0x7fc29813b000 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29db9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29813d8a0 con 0x7fc2980a9a80 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc297fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 0x7fc29813aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29cb9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc2980b3f80 0x7fc29813dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52330/0 (socket says 172.21.15.50:52330) 2022-05-02T09:41:48.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.030+0000 7fc29cb9b700 1 -- 172.21.15.50:0/3888099551 learned_addr learned my addr 172.21.15.50:0/3888099551 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:48.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7fc29d39c700 1 --2- 172.21.15.50:0/3888099551 >> v2:172.21.15.50:3300/0 conn(0x7fc29813b000 0x7fc2981481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7ff08e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 0x7ff09013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7ff08dd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 0x7ff09013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7ff08e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 0x7ff09013dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35978/0 (socket says 172.21.15.50:35978) 2022-05-02T09:41:48.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7ff08e59c700 1 -- 172.21.15.50:0/1490916350 learned_addr learned my addr 172.21.15.50:0/1490916350 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7fc297fff700 1 -- 172.21.15.50:0/3888099551 >> v2:172.21.15.50:3300/0 conn(0x7fc29813b000 msgr2=0x7fc2981481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7fc297fff700 1 --2- 172.21.15.50:0/3888099551 >> v2:172.21.15.50:3300/0 conn(0x7fc29813b000 0x7fc2981481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7fc297fff700 1 -- 172.21.15.50:0/3888099551 >> v1:172.21.15.50:6789/0 conn(0x7fc2980b3f80 legacy=0x7fc29813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.031+0000 7fc297fff700 1 -- 172.21.15.50:0/3888099551 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29813e710 con 0x7fc2980a9a80 2022-05-02T09:41:48.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.032+0000 7fc297fff700 1 --2- 172.21.15.50:0/3888099551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 0x7fc29813aac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc284009760 tx=0x7fc284009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f47547fab18e43 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7fc2977fe700 1 -- 172.21.15.50:0/3888099551 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284004030 con 0x7fc2980a9a80 2022-05-02T09:41:48.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7fc2977fe700 1 -- 172.21.15.50:0/3888099551 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284004190 con 0x7fc2980a9a80 2022-05-02T09:41:48.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7fc2977fe700 1 -- 172.21.15.50:0/3888099551 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284011630 con 0x7fc2980a9a80 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7ff08dd9b700 1 -- 172.21.15.50:0/1490916350 >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 msgr2=0x7ff09013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7ff08dd9b700 1 --2- 172.21.15.50:0/1490916350 >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 0x7ff09013dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7ff08dd9b700 1 -- 172.21.15.50:0/1490916350 >> v1:172.21.15.50:6789/0 conn(0x7ff0900a9a80 legacy=0x7ff090140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7ff08dd9b700 1 -- 172.21.15.50:0/1490916350 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09013e710 con 0x7ff09013e280 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.033+0000 7ff08dd9b700 1 --2- 172.21.15.50:0/1490916350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 0x7ff09013aac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff080009760 tx=0x7ff080009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118ca06208b8d5fb server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7ff08d59a700 1 -- 172.21.15.50:0/1490916350 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011630 con 0x7ff09013e280 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7ff08d59a700 1 -- 172.21.15.50:0/1490916350 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080011790 con 0x7ff09013e280 2022-05-02T09:41:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7ff08d59a700 1 -- 172.21.15.50:0/1490916350 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011b50 con 0x7ff09013e280 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 -- 172.21.15.50:0/3888099551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 msgr2=0x7fc29813aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 --2- 172.21.15.50:0/3888099551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 0x7fc29813aac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc284009760 tx=0x7fc284009060 comp rx=0 tx=0).stop 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 -- 172.21.15.50:0/3888099551 shutdown_connections 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 --2- 172.21.15.50:0/3888099551 >> v2:172.21.15.50:3300/0 conn(0x7fc29813b000 0x7fc2981481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 --2- 172.21.15.50:0/3888099551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980a9a80 0x7fc29813aac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.034+0000 7fc29db9d700 1 -- 172.21.15.50:0/3888099551 >> 172.21.15.50:0/3888099551 conn(0x7fc298069580 msgr2=0x7fc2980674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7fc29db9d700 1 -- 172.21.15.50:0/3888099551 shutdown_connections 2022-05-02T09:41:48.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7fc29db9d700 1 -- 172.21.15.50:0/3888099551 wait complete. 2022-05-02T09:41:48.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 -- 172.21.15.50:0/1490916350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 msgr2=0x7ff09013aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 --2- 172.21.15.50:0/1490916350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 0x7ff09013aac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff080009760 tx=0x7ff080009060 comp rx=0 tx=0).stop 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 -- 172.21.15.50:0/1490916350 shutdown_connections 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 --2- 172.21.15.50:0/1490916350 >> v2:172.21.15.50:3300/0 conn(0x7ff0900b3f80 0x7ff09013dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 --2- 172.21.15.50:0/1490916350 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff09013e280 0x7ff09013aac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.035+0000 7ff08f59e700 1 -- 172.21.15.50:0/1490916350 >> 172.21.15.50:0/1490916350 conn(0x7ff090069580 msgr2=0x7ff0900674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.036+0000 7ff08f59e700 1 -- 172.21.15.50:0/1490916350 shutdown_connections 2022-05-02T09:41:48.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.036+0000 7ff08f59e700 1 -- 172.21.15.50:0/1490916350 wait complete. 2022-05-02T09:41:48.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.037+0000 7fc29db9d700 1 Processor -- start 2022-05-02T09:41:48.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.038+0000 7fc29db9d700 1 -- start start 2022-05-02T09:41:48.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.038+0000 7ff08f59e700 1 Processor -- start 2022-05-02T09:41:48.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7ff08f59e700 1 -- start start 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2980a9a80 0x7fc29813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 0x7fc2980aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc29813b000 0x7fc2980ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298140d10 con 0x7fc29813b000 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc298140f40 con 0x7fc2980b3f80 2022-05-02T09:41:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.039+0000 7fc29db9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc298141200 con 0x7fc2980a9a80 2022-05-02T09:41:48.043 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7fc297fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 0x7fc2980aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.043 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7fc297fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 0x7fc2980aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50542/0 (socket says 172.21.15.50:50542) 2022-05-02T09:41:48.043 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7fc297fff700 1 -- 172.21.15.50:0/3491033588 learned_addr learned my addr 172.21.15.50:0/3491033588 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.043 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 -- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2980a9a80 msgr2=0x7fc29813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.044 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 --2- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2980a9a80 0x7fc29813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.044 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 -- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc29813b000 msgr2=0x7fc2980ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.044 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 --2- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc29813b000 0x7fc2980ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.044 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 -- 172.21.15.50:0/3491033588 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840092a0 con 0x7fc2980b3f80 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.041+0000 7fc297fff700 1 --2- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 0x7fc2980aa520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc284009e00 tx=0x7fc284016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840038c0 con 0x7fc2980b3f80 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284003a40 con 0x7fc2980b3f80 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284003e00 con 0x7fc2980b3f80 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0900a9a80 0x7ff0900a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff0900b3f80 0x7ff0900a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 0x7ff090151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090151a00 con 0x7ff09013e280 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900a2130 con 0x7ff0900a9a80 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.040+0000 7ff08f59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff090151c60 con 0x7ff0900b3f80 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7ff08dd9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff0900b3f80 0x7ff0900a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7ff08ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 0x7ff090151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7ff08ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 0x7ff090151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35986/0 (socket says 172.21.15.50:35986) 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7ff08ed9d700 1 -- 172.21.15.50:0/1590806419 learned_addr learned my addr 172.21.15.50:0/1590806419 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.046 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7ff08e59c700 1 --2- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0900a9a80 0x7ff0900a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.047 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.042+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2980abeb0 con 0x7fc2980b3f80 2022-05-02T09:41:48.047 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7ff08ed9d700 1 -- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff0900b3f80 msgr2=0x7ff0900a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.047 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7ff08ed9d700 1 --2- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7ff0900b3f80 0x7ff0900a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.047 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7ff08ed9d700 1 -- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0900a9a80 msgr2=0x7ff0900a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.047 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7ff08ed9d700 1 --2- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0900a9a80 0x7ff0900a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.048 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7ff08ed9d700 1 -- 172.21.15.50:0/1590806419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800092a0 con 0x7ff09013e280 2022-05-02T09:41:48.048 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.043+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc298140040 con 0x7fc2980b3f80 2022-05-02T09:41:48.048 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.044+0000 7ff08ed9d700 1 --2- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 0x7ff090151f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c7c0 tx=0x7ff088001560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.045+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7fc284017020 con 0x7fc2980b3f80 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003840 con 0x7ff09013e280 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880039a0 con 0x7ff09013e280 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003d20 con 0x7ff09013e280 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0900a2bd0 con 0x7ff09013e280 2022-05-02T09:41:48.049 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900b4a30 con 0x7ff09013e280 2022-05-02T09:41:48.050 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.047+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff090069980 con 0x7ff09013e280 2022-05-02T09:41:48.050 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2980aaa60 con 0x7fc2980b3f80 2022-05-02T09:41:48.051 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7fc29cb9b700 1 -- 172.21.15.50:0/3491033588 >> v1:172.21.15.50:6800/30011 conn(0x7fc280038e50 legacy=0x7fc28003b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.051 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc28404c6c0 con 0x7fc2980b3f80 2022-05-02T09:41:48.051 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.046+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 --> v1:172.21.15.50:6801/30634 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2800456d0 con 0x7fc2800419f0 2022-05-02T09:41:48.051 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.048+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc284032e70 con 0x7fc2980b3f80 2022-05-02T09:41:48.051 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.049+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== osd.0 v1:172.21.15.50:6801/30634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fc2800456d0 con 0x7fc2800419f0 2022-05-02T09:41:48.052 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.050+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7ff088010050 con 0x7ff09013e280 2022-05-02T09:41:48.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.051+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff08804b4a0 con 0x7ff09013e280 2022-05-02T09:41:48.054 INFO:teuthology.orchestra.run.smithi050.stdout:42949672995 2022-05-02T09:41:48.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:41:48.054 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.051+0000 7ff08e59c700 1 -- 172.21.15.50:0/1590806419 >> v1:172.21.15.50:6800/30011 conn(0x7ff06c038ed0 legacy=0x7ff06c03b380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.051+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 --> v1:172.21.15.50:6809/30638 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff06c045850 con 0x7ff06c041b70 2022-05-02T09:41:48.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.051+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff08804b790 con 0x7ff09013e280 2022-05-02T09:41:48.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.053+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== osd.1 v1:172.21.15.50:6809/30638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7ff06c045850 con 0x7ff06c041b70 2022-05-02T09:41:48.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.060+0000 7f54187ff700 1 Processor -- start 2022-05-02T09:41:48.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.061+0000 7f54187ff700 1 -- start start 2022-05-02T09:41:48.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54100636c0 0x7f54100a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f541013ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f54100a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54100a3900 con 0x7f54100636c0 2022-05-02T09:41:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5410063a90 con 0x7f54100a1e80 2022-05-02T09:41:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.062+0000 7f54187ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a2920 con 0x7f541013b360 2022-05-02T09:41:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.063+0000 7f5415d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f541013ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.063+0000 7f5415d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f541013ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50546/0 (socket says 172.21.15.50:50546) 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.063+0000 7f5415d9a700 1 -- 172.21.15.50:0/2171446322 learned_addr learned my addr 172.21.15.50:0/2171446322 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.063+0000 7f5416d9c700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f54100a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.064+0000 7f5416d9c700 1 -- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 msgr2=0x7f541013ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.064+0000 7f5416d9c700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f541013ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.064+0000 7f5416d9c700 1 -- 172.21.15.50:0/2171446322 >> v2:172.21.15.50:3300/0 conn(0x7f54100636c0 msgr2=0x7f54100a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.064+0000 7f5416d9c700 1 --2- 172.21.15.50:0/2171446322 >> v2:172.21.15.50:3300/0 conn(0x7f54100636c0 0x7f54100a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.064+0000 7f5416d9c700 1 -- 172.21.15.50:0/2171446322 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54100a0fc0 con 0x7f541013b360 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.065+0000 7f5416d9c700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f54100a4600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5408009e60 tx=0x7f5408009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd28331ae0005dd server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.065+0000 7f5415599700 1 -- 172.21.15.50:0/2171446322 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800e070 con 0x7f541013b360 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.065+0000 7f5415599700 1 -- 172.21.15.50:0/2171446322 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800bb60 con 0x7f541013b360 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.065+0000 7f5415599700 1 -- 172.21.15.50:0/2171446322 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408012430 con 0x7f541013b360 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 -- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 msgr2=0x7f54100a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f54100a4600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5408009e60 tx=0x7f5408009780 comp rx=0 tx=0).stop 2022-05-02T09:41:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 -- 172.21.15.50:0/2171446322 shutdown_connections 2022-05-02T09:41:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f54100a4600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 --2- 172.21.15.50:0/2171446322 >> v2:172.21.15.50:3300/0 conn(0x7f54100636c0 0x7f54100a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 --2- 172.21.15.50:0/2171446322 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f541013ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 -- 172.21.15.50:0/2171446322 >> 172.21.15.50:0/2171446322 conn(0x7f5410067eb0 msgr2=0x7f5410062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.066+0000 7f54187ff700 1 -- 172.21.15.50:0/2171446322 shutdown_connections 2022-05-02T09:41:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.067+0000 7f54187ff700 1 -- 172.21.15.50:0/2171446322 wait complete. 2022-05-02T09:41:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.069+0000 7f54187ff700 1 Processor -- start 2022-05-02T09:41:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.069+0000 7f54187ff700 1 -- start start 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54100636c0 0x7f541006b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f5410152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f5410152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410151f30 con 0x7f54100636c0 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a0800 con 0x7f54100a1e80 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.071+0000 7f54187ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5410152120 con 0x7f541013b360 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.072+0000 7f5415d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f5410152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.072+0000 7f5415d9a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f5410152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50548/0 (socket says 172.21.15.50:50548) 2022-05-02T09:41:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.072+0000 7f5415d9a700 1 -- 172.21.15.50:0/398477097 learned_addr learned my addr 172.21.15.50:0/398477097 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.072+0000 7f5416d9c700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f5410152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.072+0000 7f541659b700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54100636c0 0x7f541006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 -- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 msgr2=0x7f5410152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54100a1e80 0x7f5410152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 -- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54100636c0 msgr2=0x7f541006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54100636c0 0x7f541006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 -- 172.21.15.50:0/398477097 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009a20 con 0x7f541013b360 2022-05-02T09:41:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f541659b700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54100636c0 0x7f541006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.073+0000 7f5416d9c700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f5410152ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54100a6fb0 tx=0x7f5408019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.074+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408012c00 con 0x7f541013b360 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.074+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408012d60 con 0x7f541013b360 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.074+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408026620 con 0x7f541013b360 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.074+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541014fb00 con 0x7f541013b360 2022-05-02T09:41:48.078 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.075+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541013d650 con 0x7f541013b360 2022-05-02T09:41:48.079 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.076+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54100a3db0 con 0x7f541013b360 2022-05-02T09:41:48.079 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.076+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f54080269d0 con 0x7f541013b360 2022-05-02T09:41:48.079 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.077+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f54080563a0 con 0x7f541013b360 2022-05-02T09:41:48.080 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.077+0000 7f541659b700 1 -- 172.21.15.50:0/398477097 >> v1:172.21.15.50:6800/30011 conn(0x7f53f0038e50 legacy=0x7f53f003b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.080 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.077+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 --> v1:172.21.15.50:6813/30665 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f0045750 con 0x7f53f0041a70 2022-05-02T09:41:48.080 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.077+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54080566c0 con 0x7f541013b360 2022-05-02T09:41:48.081 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.079+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== osd.3 v1:172.21.15.50:6813/30665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f53f0045750 con 0x7f53f0041a70 2022-05-02T09:41:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.082+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 --> v1:172.21.15.50:6801/30634 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc29814e880 con 0x7fc2800419f0 2022-05-02T09:41:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.082+0000 7fc294ff9700 1 -- 172.21.15.50:0/3491033588 <== osd.0 v1:172.21.15.50:6801/30634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 445611385) 0x7fc29814e880 con 0x7fc2800419f0 2022-05-02T09:41:48.085 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.083+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 >> v1:172.21.15.50:6801/30634 conn(0x7fc2800419f0 legacy=0x7fc280043e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.083+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 >> v1:172.21.15.50:6800/30011 conn(0x7fc280038e50 legacy=0x7fc28003b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.083+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 msgr2=0x7fc2980aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.083+0000 7fc29db9d700 1 --2- 172.21.15.50:0/3491033588 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2980b3f80 0x7fc2980aa520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc284009e00 tx=0x7fc284016000 comp rx=0 tx=0).stop 2022-05-02T09:41:48.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.083+0000 7fc29d39c700 1 -- 172.21.15.50:0/3491033588 reap_dead start 2022-05-02T09:41:48.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.084+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 shutdown_connections 2022-05-02T09:41:48.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.084+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 >> 172.21.15.50:0/3491033588 conn(0x7fc298069580 msgr2=0x7fc2980643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.084+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 shutdown_connections 2022-05-02T09:41:48.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.084+0000 7fc29db9d700 1 -- 172.21.15.50:0/3491033588 wait complete. 2022-05-02T09:41:48.089 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.087+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 --> v1:172.21.15.50:6809/30638 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0900b12b0 con 0x7ff06c041b70 2022-05-02T09:41:48.090 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.088+0000 7ff07e7fc700 1 -- 172.21.15.50:0/1590806419 <== osd.1 v1:172.21.15.50:6809/30638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 445611385) 0x7ff0900b12b0 con 0x7ff06c041b70 2022-05-02T09:41:48.090 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.088+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 >> v1:172.21.15.50:6809/30638 conn(0x7ff06c041b70 legacy=0x7ff06c043fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.088+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 >> v1:172.21.15.50:6800/30011 conn(0x7ff06c038ed0 legacy=0x7ff06c03b380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.088+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 msgr2=0x7ff090151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.088+0000 7ff08f59e700 1 --2- 172.21.15.50:0/1590806419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff09013e280 0x7ff090151f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c7c0 tx=0x7ff088001560 comp rx=0 tx=0).stop 2022-05-02T09:41:48.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.089+0000 7ff08ed9d700 1 -- 172.21.15.50:0/1590806419 reap_dead start 2022-05-02T09:41:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.089+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 shutdown_connections 2022-05-02T09:41:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.089+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 >> 172.21.15.50:0/1590806419 conn(0x7ff090069580 msgr2=0x7ff09013b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.090+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 shutdown_connections 2022-05-02T09:41:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.090+0000 7ff08f59e700 1 -- 172.21.15.50:0/1590806419 wait complete. 2022-05-02T09:41:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.099+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 --> v1:172.21.15.50:6813/30665 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f541004bfb0 con 0x7f53f0041a70 2022-05-02T09:41:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.100+0000 7f53fe7fc700 1 -- 172.21.15.50:0/398477097 <== osd.3 v1:172.21.15.50:6813/30665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 445611385) 0x7f541004bfb0 con 0x7f53f0041a70 2022-05-02T09:41:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 >> v1:172.21.15.50:6813/30665 conn(0x7f53f0041a70 legacy=0x7f53f0043ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 >> v1:172.21.15.50:6800/30011 conn(0x7f53f0038e50 legacy=0x7f53f003b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 msgr2=0x7f5410152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 --2- 172.21.15.50:0/398477097 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f541013b360 0x7f5410152ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54100a6fb0 tx=0x7f5408019000 comp rx=0 tx=0).stop 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f5416d9c700 1 -- 172.21.15.50:0/398477097 reap_dead start 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 shutdown_connections 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 >> 172.21.15.50:0/398477097 conn(0x7f5410067eb0 msgr2=0x7f5410139ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 shutdown_connections 2022-05-02T09:41:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.101+0000 7f54187ff700 1 -- 172.21.15.50:0/398477097 wait complete. 2022-05-02T09:41:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:42949672995 2022-05-02T09:41:48.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:41:48.128 INFO:teuthology.orchestra.run.smithi050.stdout:42949672995 2022-05-02T09:41:48.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:41:48.141 INFO:teuthology.orchestra.run.smithi050.stdout:42949672995 2022-05-02T09:41:48.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:41:48.177 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:48.169+0000 7f3cc1ad2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-05-02T09:41:48.188 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:48.181+0000 7fe919806000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-05-02T09:41:48.319 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:48.317+0000 7f3cc1ad2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-05-02T09:41:48.357 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:48.355+0000 7fe919806000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-05-02T09:41:48.368 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.366+0000 7f8d42fff700 1 Processor -- start 2022-05-02T09:41:48.368 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.366+0000 7f8d42fff700 1 -- start start 2022-05-02T09:41:48.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.367+0000 7f8d42fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d3c0a9830 0x7f8d3c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.367+0000 7f8d42fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d42fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c0a9310 con 0x7f8d3c13dfe0 2022-05-02T09:41:48.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d42fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c0a90a0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d42fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0a7fe0 con 0x7f8d3c13e790 2022-05-02T09:41:48.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d4159c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d3c13dfe0 0x7f8d3c141520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52334/0 (socket says 172.21.15.50:52334) 2022-05-02T09:41:48.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d4159c700 1 -- 172.21.15.50:0/4067069246 learned_addr learned my addr 172.21.15.50:0/4067069246 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:48.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.368+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/4067069246 >> v2:172.21.15.50:3300/0 conn(0x7f8d3c0a9830 0x7f8d3c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.369+0000 7f8d3bfff700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.369+0000 7f8d40d9b700 1 -- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 msgr2=0x7f8d3c140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.369+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.369+0000 7f8d40d9b700 1 -- 172.21.15.50:0/4067069246 >> v1:172.21.15.50:6789/0 conn(0x7f8d3c13dfe0 legacy=0x7f8d3c141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.369+0000 7f8d40d9b700 1 -- 172.21.15.50:0/4067069246 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c0a8280 con 0x7f8d3c0a9830 2022-05-02T09:41:48.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.370+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c0a5800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009760 tx=0x7f8d30009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd51d475998db07 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.370+0000 7f8d3b7fe700 1 -- 172.21.15.50:0/4067069246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30011630 con 0x7f8d3c0a9830 2022-05-02T09:41:48.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.370+0000 7f8d3b7fe700 1 -- 172.21.15.50:0/4067069246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30011790 con 0x7f8d3c0a9830 2022-05-02T09:41:48.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.370+0000 7f8d3b7fe700 1 -- 172.21.15.50:0/4067069246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30011b30 con 0x7f8d3c0a9830 2022-05-02T09:41:48.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.371+0000 7f8d42fff700 1 -- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 msgr2=0x7f8d3c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.371+0000 7f8d42fff700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c0a5800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009760 tx=0x7f8d30009060 comp rx=0 tx=0).stop 2022-05-02T09:41:48.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 -- 172.21.15.50:0/4067069246 shutdown_connections 2022-05-02T09:41:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c0a5800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 --2- 172.21.15.50:0/4067069246 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 -- 172.21.15.50:0/4067069246 >> 172.21.15.50:0/4067069246 conn(0x7f8d3c062df0 msgr2=0x7f8d3c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 -- 172.21.15.50:0/4067069246 shutdown_connections 2022-05-02T09:41:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.372+0000 7f8d42fff700 1 -- 172.21.15.50:0/4067069246 wait complete. 2022-05-02T09:41:48.377 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.374+0000 7f8d42fff700 1 Processor -- start 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.374+0000 7f8d42fff700 1 -- start start 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 0x7f8d3c09faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c06d2e0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0a0240 con 0x7f8d3c13dfe0 2022-05-02T09:41:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.375+0000 7f8d42fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c09f5a0 con 0x7f8d3c13e790 2022-05-02T09:41:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.376+0000 7f8d40d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.376+0000 7f8d4159c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.376+0000 7f8d40d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35994/0 (socket says 172.21.15.50:35994) 2022-05-02T09:41:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.376+0000 7f8d40d9b700 1 -- 172.21.15.50:0/66868919 learned_addr learned my addr 172.21.15.50:0/66868919 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.376+0000 7f8d3bfff700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 0x7f8d3c09faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 -- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 msgr2=0x7f8d3c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 -- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 msgr2=0x7f8d3c09faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 0x7f8d3c09faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 -- 172.21.15.50:0/66868919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d300092a0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d4159c700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d3bfff700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 0x7f8d3c09faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.377+0000 7f8d40d9b700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0a94a0 tx=0x7f8d30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.378+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d300036f0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.378+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30003850 con 0x7f8d3c0a9830 2022-05-02T09:41:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.378+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30003c10 con 0x7f8d3c0a9830 2022-05-02T09:41:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.378+0000 7f8d42fff700 1 -- 172.21.15.50:0/66868919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c09ffe0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.378+0000 7f8d42fff700 1 -- 172.21.15.50:0/66868919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c06a5c0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.380+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10005120 con 0x7f8d3c0a9830 2022-05-02T09:41:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.381+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f8d3000f050 con 0x7f8d3c0a9830 2022-05-02T09:41:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.382+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8d3004c5f0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.382+0000 7f8d3bfff700 1 -- 172.21.15.50:0/66868919 >> v1:172.21.15.50:6800/30011 conn(0x7f8d1c038e50 legacy=0x7f8d1c03b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.386+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f8d30005ab0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.492+0000 7f84affff700 1 Processor -- start 2022-05-02T09:41:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.492+0000 7f84affff700 1 -- start start 2022-05-02T09:41:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.493+0000 7f84affff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b00b3f80 0x7f84b013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.493+0000 7f84affff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 0x7f84b013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.493+0000 7f84affff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00b4350 con 0x7f84b00a9a80 2022-05-02T09:41:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.493+0000 7f84affff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00a4440 con 0x7f84b00b3f80 2022-05-02T09:41:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.493+0000 7f84affff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b013d8a0 con 0x7f84b013e280 2022-05-02T09:41:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.494+0000 7f84aeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b00b3f80 0x7f84b013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.494+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 0x7f84b013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.494+0000 7f84aeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b00b3f80 0x7f84b013dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35996/0 (socket says 172.21.15.50:35996) 2022-05-02T09:41:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.494+0000 7f84aeffd700 1 -- 172.21.15.50:0/1233642828 learned_addr learned my addr 172.21.15.50:0/1233642828 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.494+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 0x7f84b013aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49872/0 (socket says 172.21.15.50:49872) 2022-05-02T09:41:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.495+0000 7f84aeffd700 1 -- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 msgr2=0x7f84b013aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.495+0000 7f84aeffd700 1 --2- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 0x7f84b013aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.495+0000 7f84aeffd700 1 -- 172.21.15.50:0/1233642828 >> v1:172.21.15.50:6789/0 conn(0x7f84b00a9a80 legacy=0x7f84b0140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.495+0000 7f84aeffd700 1 -- 172.21.15.50:0/1233642828 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b013e710 con 0x7f84b00b3f80 2022-05-02T09:41:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.496+0000 7f84aeffd700 1 --2- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b013dd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84a4006fd0 tx=0x7f84a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7243f3e34d73a7b7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.496+0000 7f84adffb700 1 -- 172.21.15.50:0/1233642828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011630 con 0x7f84b00b3f80 2022-05-02T09:41:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.496+0000 7f84adffb700 1 -- 172.21.15.50:0/1233642828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a40117b0 con 0x7f84b00b3f80 2022-05-02T09:41:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.496+0000 7f84adffb700 1 -- 172.21.15.50:0/1233642828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011b70 con 0x7f84b00b3f80 2022-05-02T09:41:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 -- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 msgr2=0x7f84b013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 --2- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b013dd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84a4006fd0 tx=0x7f84a40090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 -- 172.21.15.50:0/1233642828 shutdown_connections 2022-05-02T09:41:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 --2- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b013dd40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 --2- 172.21.15.50:0/1233642828 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b013e280 0x7f84b013aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.497+0000 7f84affff700 1 -- 172.21.15.50:0/1233642828 >> 172.21.15.50:0/1233642828 conn(0x7f84b0069580 msgr2=0x7f84b00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.498+0000 7f84affff700 1 -- 172.21.15.50:0/1233642828 shutdown_connections 2022-05-02T09:41:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.498+0000 7f84affff700 1 -- 172.21.15.50:0/1233642828 wait complete. 2022-05-02T09:41:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.499+0000 7f84affff700 1 Processor -- start 2022-05-02T09:41:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.500+0000 7f84affff700 1 -- start start 2022-05-02T09:41:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.500+0000 7f84affff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 0x7f84b0139ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.500+0000 7f84affff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.501+0000 7f84affff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b013e280 0x7f84b014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.501+0000 7f84affff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b014d970 con 0x7f84b00b3f80 2022-05-02T09:41:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.501+0000 7f84affff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00abaa0 con 0x7f84b013e280 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.501+0000 7f84affff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00aab20 con 0x7f84b00a9a80 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.501+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84aeffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 0x7f84b0139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35998/0 (socket says 172.21.15.50:35998) 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84aeffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 0x7f84b0139ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49874/0 (socket says 172.21.15.50:49874) 2022-05-02T09:41:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 -- 172.21.15.50:0/1497923916 learned_addr learned my addr 172.21.15.50:0/1497923916 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84af7fe700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b013e280 0x7f84b014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 -- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 msgr2=0x7f84b0139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 0x7f84b0139ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 -- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b013e280 msgr2=0x7f84b014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b013e280 0x7f84b014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.502+0000 7f84ae7fc700 1 -- 172.21.15.50:0/1497923916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4009370 con 0x7f84b00b3f80 2022-05-02T09:41:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.503+0000 7f84ae7fc700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84a000e930 tx=0x7f84a0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.504+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0013680 con 0x7f84b00b3f80 2022-05-02T09:41:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.504+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00137e0 con 0x7f84b00b3f80 2022-05-02T09:41:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.504+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b01419f0 con 0x7f84b00b3f80 2022-05-02T09:41:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.504+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0013b60 con 0x7f84b00b3f80 2022-05-02T09:41:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.504+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0140b10 con 0x7f84b00b3f80 2022-05-02T09:41:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.506+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00a9890 con 0x7f84b00b3f80 2022-05-02T09:41:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.506+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f84a0019030 con 0x7f84b00b3f80 2022-05-02T09:41:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.507+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f84a004adc0 con 0x7f84b00b3f80 2022-05-02T09:41:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.507+0000 7f84aeffd700 1 -- 172.21.15.50:0/1497923916 >> v1:172.21.15.50:6800/30011 conn(0x7f8490038e80 legacy=0x7f849003b330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.511+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f84a0033490 con 0x7f84b00b3f80 2022-05-02T09:41:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.537+0000 7fb58919d700 1 Processor -- start 2022-05-02T09:41:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.537+0000 7fb58919d700 1 -- start start 2022-05-02T09:41:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.538+0000 7fb58919d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 0x7fb584141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.538+0000 7fb58919d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.539+0000 7fb58919d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58413e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.539+0000 7fb58919d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584140ff0 con 0x7fb5840636c0 2022-05-02T09:41:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.539+0000 7fb58919d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb584063a90 con 0x7fb5841419c0 2022-05-02T09:41:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.539+0000 7fb58919d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840a9200 con 0x7fb5840a9bf0 2022-05-02T09:41:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.539+0000 7fb5837fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb583fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 0x7fb584141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50554/0 (socket says 172.21.15.50:50554) 2022-05-02T09:41:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 -- 172.21.15.50:0/2765589491 learned_addr learned my addr 172.21.15.50:0/2765589491 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb58899c700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 -- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 msgr2=0x7fb58413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 -- 172.21.15.50:0/2765589491 >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 msgr2=0x7fb584141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 --2- 172.21.15.50:0/2765589491 >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 0x7fb584141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.540+0000 7fb5837fe700 1 -- 172.21.15.50:0/2765589491 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584141e50 con 0x7fb5841419c0 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.541+0000 7fb58899c700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.541+0000 7fb583fff700 1 --2- 172.21.15.50:0/2765589491 >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 0x7fb584141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.541+0000 7fb5837fe700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb578009830 tx=0x7fb5780090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f073d476c7517b6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.542+0000 7fb582ffd700 1 -- 172.21.15.50:0/2765589491 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578004030 con 0x7fb5841419c0 2022-05-02T09:41:48.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.542+0000 7fb582ffd700 1 -- 172.21.15.50:0/2765589491 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578004190 con 0x7fb5841419c0 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.542+0000 7fb582ffd700 1 -- 172.21.15.50:0/2765589491 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578011630 con 0x7fb5841419c0 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 -- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 msgr2=0x7fb58413e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb578009830 tx=0x7fb5780090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 -- 172.21.15.50:0/2765589491 shutdown_connections 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 --2- 172.21.15.50:0/2765589491 >> v2:172.21.15.50:3300/0 conn(0x7fb5840636c0 0x7fb584141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 --2- 172.21.15.50:0/2765589491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5841419c0 0x7fb58413e000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 -- 172.21.15.50:0/2765589491 >> 172.21.15.50:0/2765589491 conn(0x7fb584069370 msgr2=0x7fb584062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 -- 172.21.15.50:0/2765589491 shutdown_connections 2022-05-02T09:41:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.543+0000 7fb58919d700 1 -- 172.21.15.50:0/2765589491 wait complete. 2022-05-02T09:41:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.546+0000 7fb58919d700 1 Processor -- start 2022-05-02T09:41:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.546+0000 7fb58919d700 1 -- start start 2022-05-02T09:41:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5840636c0 0x7fb5840a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58406ba90 con 0x7fb5841419c0 2022-05-02T09:41:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840a0910 con 0x7fb5840636c0 2022-05-02T09:41:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.547+0000 7fb58919d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb58406c720 con 0x7fb5840a9bf0 2022-05-02T09:41:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.549+0000 7fb583fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5840636c0 0x7fb5840a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.549+0000 7fb58899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.549+0000 7fb58899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36002/0 (socket says 172.21.15.50:36002) 2022-05-02T09:41:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.549+0000 7fb58899c700 1 -- 172.21.15.50:0/3925124311 learned_addr learned my addr 172.21.15.50:0/3925124311 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.551+0000 7fb5837fe700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.552+0000 7fb58899c700 1 -- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 msgr2=0x7fb58406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.552+0000 7fb58899c700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.552+0000 7fb58899c700 1 -- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5840636c0 msgr2=0x7fb5840a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.552+0000 7fb58899c700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5840636c0 0x7fb5840a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.552+0000 7fb58899c700 1 -- 172.21.15.50:0/3925124311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740092a0 con 0x7fb5841419c0 2022-05-02T09:41:48.556 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.554+0000 7fb58899c700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cfc0 tx=0x7fb57c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.554+0000 7f69c159d700 1 Processor -- start 2022-05-02T09:41:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.554+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c015440 con 0x7fb5841419c0 2022-05-02T09:41:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.554+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c0155a0 con 0x7fb5841419c0 2022-05-02T09:41:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.555+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c015960 con 0x7fb5841419c0 2022-05-02T09:41:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.555+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb578009370 con 0x7fb5841419c0 2022-05-02T09:41:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.555+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58409f6e0 con 0x7fb5841419c0 2022-05-02T09:41:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.555+0000 7f69c159d700 1 -- start start 2022-05-02T09:41:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.556+0000 7f69c159d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.556+0000 7f69c159d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 0x7f69bc139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.556+0000 7f69c159d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc06f0a0 con 0x7f69bc13a160 2022-05-02T09:41:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.556+0000 7f69c159d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc13a8b0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.556+0000 7f69c159d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0a3d70 con 0x7f69bc0a39a0 2022-05-02T09:41:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.557+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.557+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49880/0 (socket says 172.21.15.50:49880) 2022-05-02T09:41:48.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.557+0000 7f69bbfff700 1 -- 172.21.15.50:0/3974044937 learned_addr learned my addr 172.21.15.50:0/3974044937 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.557+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840b1350 con 0x7fb5841419c0 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.558+0000 7f69bb7fe700 1 --2- 172.21.15.50:0/3974044937 >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 0x7f69bc139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.558+0000 7f69bbfff700 1 -- 172.21.15.50:0/3974044937 >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 msgr2=0x7f69bc139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.559+0000 7f69bbfff700 1 --2- 172.21.15.50:0/3974044937 >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 0x7f69bc139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.559+0000 7f69bbfff700 1 -- 172.21.15.50:0/3974044937 >> v1:172.21.15.50:6789/0 conn(0x7f69bc13a160 legacy=0x7f69bc13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.559+0000 7f69bbfff700 1 -- 172.21.15.50:0/3974044937 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc06f600 con 0x7f69bc0a39a0 2022-05-02T09:41:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.559+0000 7f69bb7fe700 1 --2- 172.21.15.50:0/3974044937 >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 0x7f69bc139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.559+0000 7f69bbfff700 1 --2- 172.21.15.50:0/3974044937 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69a4006fd0 tx=0x7f69a4008190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=647c84b4c3e868fe server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.558+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7fb57c0143a0 con 0x7fb5841419c0 2022-05-02T09:41:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.560+0000 7f69baffd700 1 -- 172.21.15.50:0/3974044937 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4010070 con 0x7f69bc0a39a0 2022-05-02T09:41:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.560+0000 7f69baffd700 1 -- 172.21.15.50:0/3974044937 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4004030 con 0x7f69bc0a39a0 2022-05-02T09:41:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.560+0000 7f69baffd700 1 -- 172.21.15.50:0/3974044937 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40043d0 con 0x7f69bc0a39a0 2022-05-02T09:41:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.560+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb57c04b8c0 con 0x7fb5841419c0 2022-05-02T09:41:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.560+0000 7fb583fff700 1 -- 172.21.15.50:0/3925124311 >> v1:172.21.15.50:6800/30011 conn(0x7fb564038ed0 legacy=0x7fb56403b380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 -- 172.21.15.50:0/3974044937 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 msgr2=0x7f69bc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 --2- 172.21.15.50:0/3974044937 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69a4006fd0 tx=0x7f69a4008190 comp rx=0 tx=0).stop 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 -- 172.21.15.50:0/3974044937 shutdown_connections 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 --2- 172.21.15.50:0/3974044937 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc0a39a0 0x7f69bc06eb60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 --2- 172.21.15.50:0/3974044937 >> v2:172.21.15.50:3300/0 conn(0x7f69bc0a1ac0 0x7f69bc139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.561+0000 7f69c159d700 1 -- 172.21.15.50:0/3974044937 >> 172.21.15.50:0/3974044937 conn(0x7f69bc062df0 msgr2=0x7f69bc0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.562+0000 7f69c159d700 1 -- 172.21.15.50:0/3974044937 shutdown_connections 2022-05-02T09:41:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.562+0000 7f69c159d700 1 -- 172.21.15.50:0/3974044937 wait complete. 2022-05-02T09:41:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.564+0000 7f69c159d700 1 Processor -- start 2022-05-02T09:41:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.565+0000 7f69c159d700 1 -- start start 2022-05-02T09:41:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7fb57c030560 con 0x7fb5841419c0 2022-05-02T09:41:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69bc0a39a0 0x7f69bc0ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc13a160 0x7f69bc152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc13b850 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc13b5e0 con 0x7f69bc0a39a0 2022-05-02T09:41:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.566+0000 7f69c159d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc138d00 con 0x7f69bc13a160 2022-05-02T09:41:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.567+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.567+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36006/0 (socket says 172.21.15.50:36006) 2022-05-02T09:41:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.567+0000 7f69bbfff700 1 -- 172.21.15.50:0/3758500695 learned_addr learned my addr 172.21.15.50:0/3758500695 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.567+0000 7f69bb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69bc0a39a0 0x7f69bc0ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.567+0000 7f69c0d9c700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc13a160 0x7f69bc152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.568+0000 7f69bbfff700 1 -- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc13a160 msgr2=0x7f69bc152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.568+0000 7f69bbfff700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc13a160 0x7f69bc152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.568+0000 7f69bbfff700 1 -- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69bc0a39a0 msgr2=0x7f69bc0ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.568+0000 7f69bbfff700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69bc0a39a0 0x7f69bc0ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.568+0000 7f69bbfff700 1 -- 172.21.15.50:0/3758500695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0092a0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.569+0000 7f69bbfff700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69a400d6c0 tx=0x7f69a401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.569+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4009d00 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.569+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4009e60 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.569+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4003730 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.570+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d100053d0 con 0x7f8d3c0a9830 2022-05-02T09:41:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.569+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a40083f0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.570+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc13c8c0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.571+0000 7f8d38ff9700 1 -- 172.21.15.50:0/66868919 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d30007d90 con 0x7f8d3c0a9830 2022-05-02T09:41:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.571+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc063a90 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.574 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 >> v1:172.21.15.50:6800/30011 conn(0x7f8d1c038e50 legacy=0x7f8d1c03b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 msgr2=0x7f8d3c06dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0a94a0 tx=0x7f8d30017000 comp rx=0 tx=0).stop 2022-05-02T09:41:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.572+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f69a4028030 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.573+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f69a404bf10 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f69bb7fe700 1 -- 172.21.15.50:0/3758500695 >> v1:172.21.15.50:6800/30011 conn(0x7f69a0038e50 legacy=0x7f69a003b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 shutdown_connections 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8d3c13e790 0x7f8d3c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0a9830 0x7f8d3c06dff0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 --2- 172.21.15.50:0/66868919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8d3c13dfe0 0x7f8d3c09faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.574+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 >> 172.21.15.50:0/66868919 conn(0x7f8d3c062df0 msgr2=0x7f8d3c0a4710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.575+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 shutdown_connections 2022-05-02T09:41:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.575+0000 7f8d227fc700 1 -- 172.21.15.50:0/66868919 wait complete. 2022-05-02T09:41:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.577+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f69a4008890 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.2 2022-05-02T09:41:48.669 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:48.667+0000 7fe919806000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-05-02T09:41:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.687+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84b004b770 con 0x7f84b00b3f80 2022-05-02T09:41:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.688+0000 7f8496ffd700 1 -- 172.21.15.50:0/1497923916 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84a0033080 con 0x7f84b00b3f80 2022-05-02T09:41:48.693 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 >> v1:172.21.15.50:6800/30011 conn(0x7f8490038e80 legacy=0x7f849003b330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 msgr2=0x7f84b01414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84a000e930 tx=0x7f84a0009060 comp rx=0 tx=0).stop 2022-05-02T09:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 shutdown_connections 2022-05-02T09:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f84b00a9a80 0x7f84b0139ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84b013e280 0x7f84b014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 --2- 172.21.15.50:0/1497923916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b00b3f80 0x7f84b01414b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 >> 172.21.15.50:0/1497923916 conn(0x7f84b0069580 msgr2=0x7f84b013d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.690+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 shutdown_connections 2022-05-02T09:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.691+0000 7f84affff700 1 -- 172.21.15.50:0/1497923916 wait complete. 2022-05-02T09:41:48.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.1 2022-05-02T09:41:48.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.718+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69bc13c8c0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.718+0000 7f69b3fff700 1 -- 172.21.15.50:0/3758500695 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69bc13c8c0 con 0x7f69bc0a1ac0 2022-05-02T09:41:48.721 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 >> v1:172.21.15.50:6800/30011 conn(0x7f69a0038e50 legacy=0x7f69a003b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 msgr2=0x7f69bc13b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69a400d6c0 tx=0x7f69a401b000 comp rx=0 tx=0).stop 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 shutdown_connections 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f69bc13a160 0x7f69bc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69bc0a1ac0 0x7f69bc13b070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 --2- 172.21.15.50:0/3758500695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69bc0a39a0 0x7f69bc0ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 >> 172.21.15.50:0/3758500695 conn(0x7f69bc062df0 msgr2=0x7f69bc06b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 shutdown_connections 2022-05-02T09:41:48.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.720+0000 7f69c159d700 1 -- 172.21.15.50:0/3758500695 wait complete. 2022-05-02T09:41:48.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2022-05-02T09:41:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.761+0000 7fb583fff700 1 -- 172.21.15.50:0/3925124311 >> v1:172.21.15.50:6800/30011 conn(0x7fb564038ed0 legacy=0x7fb56403b380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:48.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.804+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5840b1140 con 0x7fb5841419c0 2022-05-02T09:41:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.804+0000 7fb56bfff700 1 -- 172.21.15.50:0/3925124311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb57c01a070 con 0x7fb5841419c0 2022-05-02T09:41:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 >> v1:172.21.15.50:6800/30011 conn(0x7fb564038ed0 legacy=0x7fb56403b380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 msgr2=0x7fb584155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cfc0 tx=0x7fb57c0078d0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 shutdown_connections 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841419c0 0x7fb584155570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5840636c0 0x7fb5840a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 --2- 172.21.15.50:0/3925124311 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb5840a9bf0 0x7fb58406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:48.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 >> 172.21.15.50:0/3925124311 conn(0x7fb584069370 msgr2=0x7fb58413ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:48.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 shutdown_connections 2022-05-02T09:41:48.810 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:48.806+0000 7fb58919d700 1 -- 172.21.15.50:0/3925124311 wait complete. 2022-05-02T09:41:48.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.0 2022-05-02T09:41:48.917 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:48.914+0000 7f3cc1ad2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-05-02T09:41:49.028 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:48.967+0000 7fe919806000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-05-02T09:41:49.033 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:49.031+0000 7f3cc1ad2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-05-02T09:41:49.109 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:49.106+0000 7fe919806000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-05-02T09:41:49.238 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:49.236+0000 7fe919806000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-05-02T09:41:49.332 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:49.330+0000 7f3cc1ad2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-05-02T09:41:49.356 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:49.354+0000 7fe919806000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-05-02T09:41:49.443 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:49.440+0000 7f3cc1ad2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-05-02T09:41:49.606 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:49.604+0000 7f3cc1ad2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-05-02T09:41:49.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:41:49.676 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:49.674+0000 7fe919806000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-05-02T09:41:49.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:41:49.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:41:49.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:41:49.876 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:49.873+0000 7f3cc1ad2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-05-02T09:41:49.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.882+0000 7f7acd3ff700 1 Processor -- start 2022-05-02T09:41:49.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.883+0000 7f7acd3ff700 1 -- start start 2022-05-02T09:41:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.884+0000 7f7acd3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.884+0000 7f7acd3ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ac80a0ca0 0x7f7ac8142890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.884+0000 7f7acd3ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac80a25a0 con 0x7f7ac8142dd0 2022-05-02T09:41:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.884+0000 7f7acd3ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8143270 con 0x7f7ac80a0ca0 2022-05-02T09:41:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.884+0000 7f7acd3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac806cab0 con 0x7f7ac80a1e80 2022-05-02T09:41:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.885+0000 7f7ac6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.885+0000 7f7ac6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50560/0 (socket says 172.21.15.50:50560) 2022-05-02T09:41:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.885+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/652528460 learned_addr learned my addr 172.21.15.50:0/652528460 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.885+0000 7f7ac67fc700 1 --2- 172.21.15.50:0/652528460 >> v2:172.21.15.50:3300/0 conn(0x7f7ac80a0ca0 0x7f7ac8142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.886+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/652528460 >> v2:172.21.15.50:3300/0 conn(0x7f7ac80a0ca0 msgr2=0x7f7ac8142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.886+0000 7f7ac6ffd700 1 --2- 172.21.15.50:0/652528460 >> v2:172.21.15.50:3300/0 conn(0x7f7ac80a0ca0 0x7f7ac8142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.886+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/652528460 >> v1:172.21.15.50:6789/0 conn(0x7f7ac8142dd0 legacy=0x7f7ac80abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.886+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/652528460 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80ad350 con 0x7f7ac80a1e80 2022-05-02T09:41:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.887+0000 7f7ac6ffd700 1 --2- 172.21.15.50:0/652528460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8006fd0 tx=0x7f7ab80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9c39cfacbfed2a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.887+0000 7f7ac5ffb700 1 -- 172.21.15.50:0/652528460 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004030 con 0x7f7ac80a1e80 2022-05-02T09:41:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.887+0000 7f7ac5ffb700 1 -- 172.21.15.50:0/652528460 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80041d0 con 0x7f7ac80a1e80 2022-05-02T09:41:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.887+0000 7f7ac5ffb700 1 -- 172.21.15.50:0/652528460 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011630 con 0x7f7ac80a1e80 2022-05-02T09:41:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 -- 172.21.15.50:0/652528460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 msgr2=0x7f7ac806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/652528460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8006fd0 tx=0x7f7ab80090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 -- 172.21.15.50:0/652528460 shutdown_connections 2022-05-02T09:41:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/652528460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a1e80 0x7f7ac806bbd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/652528460 >> v2:172.21.15.50:3300/0 conn(0x7f7ac80a0ca0 0x7f7ac8142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.888+0000 7f7acd3ff700 1 -- 172.21.15.50:0/652528460 >> 172.21.15.50:0/652528460 conn(0x7f7ac8062df0 msgr2=0x7f7ac80631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.889+0000 7f7acd3ff700 1 -- 172.21.15.50:0/652528460 shutdown_connections 2022-05-02T09:41:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.889+0000 7f7acd3ff700 1 -- 172.21.15.50:0/652528460 wait complete. 2022-05-02T09:41:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.891+0000 7f7acd3ff700 1 Processor -- start 2022-05-02T09:41:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.891+0000 7f7acd3ff700 1 -- start start 2022-05-02T09:41:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 0x7f7ac8099f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 0x7f7ac81417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac809b0b0 con 0x7f7ac8142dd0 2022-05-02T09:41:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80991a0 con 0x7f7ac80a0ca0 2022-05-02T09:41:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7acd3ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8099460 con 0x7f7ac80a1e80 2022-05-02T09:41:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36010/0 (socket says 172.21.15.50:36010) 2022-05-02T09:41:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7ac77fe700 1 -- 172.21.15.50:0/3610466207 learned_addr learned my addr 172.21.15.50:0/3610466207 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.893+0000 7f7ac6ffd700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 0x7f7ac8099f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac67fc700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 0x7f7ac81417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac77fe700 1 -- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 msgr2=0x7f7ac81417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac77fe700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 0x7f7ac81417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac77fe700 1 -- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 msgr2=0x7f7ac8099f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac77fe700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 0x7f7ac8099f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac77fe700 1 -- 172.21.15.50:0/3610466207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009370 con 0x7f7ac8142dd0 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac6ffd700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 0x7f7ac8099f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:41:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.894+0000 7f7ac67fc700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 0x7f7ac81417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:41:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.895+0000 7f7ac77fe700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000c790 tx=0x7f7ac0001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.895+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0003840 con 0x7f7ac8142dd0 2022-05-02T09:41:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.895+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00039a0 con 0x7f7ac8142dd0 2022-05-02T09:41:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.895+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0003d20 con 0x7f7ac8142dd0 2022-05-02T09:41:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.896+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8142270 con 0x7f7ac8142dd0 2022-05-02T09:41:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.896+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac8146080 con 0x7f7ac8142dd0 2022-05-02T09:41:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.898+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac804bfb0 con 0x7f7ac8142dd0 2022-05-02T09:41:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.898+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f7ac0010050 con 0x7f7ac8142dd0 2022-05-02T09:41:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.899+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7ac004a840 con 0x7f7ac8142dd0 2022-05-02T09:41:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.899+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/3610466207 >> v1:172.21.15.50:6800/30011 conn(0x7f7aa8038ea0 legacy=0x7f7aa803b350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:49.905+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f7ac002f5f0 con 0x7f7ac8142dd0 2022-05-02T09:41:50.025 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.023+0000 7f05b679d700 1 Processor -- start 2022-05-02T09:41:50.026 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.023+0000 7f05b679d700 1 -- start start 2022-05-02T09:41:50.027 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.027 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05b013e280 0x7f05b013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00a9a80 0x7f05b013b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00b4350 con 0x7f05b013e280 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b579b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00a4440 con 0x7f05b00b3f80 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.025+0000 7f05b679d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05b013d8a0 con 0x7f05b00a9a80 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50566/0 (socket says 172.21.15.50:50566) 2022-05-02T09:41:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 -- 172.21.15.50:0/529996642 learned_addr learned my addr 172.21.15.50:0/529996642 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b4f9a700 1 --2- 172.21.15.50:0/529996642 >> v2:172.21.15.50:3300/0 conn(0x7f05b013e280 0x7f05b013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b5f9c700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00a9a80 0x7f05b013b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 -- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00a9a80 msgr2=0x7f05b013b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00a9a80 0x7f05b013b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 -- 172.21.15.50:0/529996642 >> v2:172.21.15.50:3300/0 conn(0x7f05b013e280 msgr2=0x7f05b013aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:50.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 --2- 172.21.15.50:0/529996642 >> v2:172.21.15.50:3300/0 conn(0x7f05b013e280 0x7f05b013aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.030 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.026+0000 7f05b579b700 1 -- 172.21.15.50:0/529996642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b013e710 con 0x7f05b00b3f80 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.027+0000 7f05b579b700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f05ac006fd0 tx=0x7f05ac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d8764335182914 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.028+0000 7f059ffff700 1 -- 172.21.15.50:0/529996642 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac004030 con 0x7f05b00b3f80 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.028+0000 7f059ffff700 1 -- 172.21.15.50:0/529996642 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac004190 con 0x7f05b00b3f80 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.028+0000 7f059ffff700 1 -- 172.21.15.50:0/529996642 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011630 con 0x7f05b00b3f80 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.028+0000 7f05b679d700 1 -- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 msgr2=0x7f05b013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.028+0000 7f05b679d700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f05ac006fd0 tx=0x7f05ac0090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.032 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f3cc1ad2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-05-02T09:41:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 -- 172.21.15.50:0/529996642 shutdown_connections 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00a9a80 0x7f05b013b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 --2- 172.21.15.50:0/529996642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b00b3f80 0x7f05b013dd40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 --2- 172.21.15.50:0/529996642 >> v2:172.21.15.50:3300/0 conn(0x7f05b013e280 0x7f05b013aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 -- 172.21.15.50:0/529996642 >> 172.21.15.50:0/529996642 conn(0x7f05b0069580 msgr2=0x7f05b00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 -- 172.21.15.50:0/529996642 shutdown_connections 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.029+0000 7f05b679d700 1 -- 172.21.15.50:0/529996642 wait complete. 2022-05-02T09:41:50.033 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.031+0000 7f05b679d700 1 Processor -- start 2022-05-02T09:41:50.034 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.032+0000 7f05b679d700 1 -- start start 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.032+0000 7f05b679d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 0x7f05b00a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.032+0000 7f05b679d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 0x7f05b00a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.032+0000 7f05b679d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 0x7f05b009f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b679d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b006dce0 con 0x7f05b00a9a80 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b679d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00a2110 con 0x7f05b013e280 2022-05-02T09:41:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b679d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00a0670 con 0x7f05b00b3f80 2022-05-02T09:41:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b5f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 0x7f05b009f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b5f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 0x7f05b009f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50568/0 (socket says 172.21.15.50:50568) 2022-05-02T09:41:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b5f9c700 1 -- 172.21.15.50:0/4143537572 learned_addr learned my addr 172.21.15.50:0/4143537572 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.033+0000 7f05b579b700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 0x7f05b00a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 0x7f05b00a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 -- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 msgr2=0x7f05b009f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 0x7f05b009f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 -- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 msgr2=0x7f05b00a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 0x7f05b00a2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.034+0000 7f05b4f9a700 1 -- 172.21.15.50:0/4143537572 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009370 con 0x7f05b00b3f80 2022-05-02T09:41:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.035+0000 7f05b579b700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 0x7f05b00a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.035+0000 7f05b4f9a700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 0x7f05b00a1810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05b00a8fc0 tx=0x7f05a0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.035+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0013680 con 0x7f05b00b3f80 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.036+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00137e0 con 0x7f05b00b3f80 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.036+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0013b60 con 0x7f05b00b3f80 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.036+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b00a0930 con 0x7f05b00b3f80 2022-05-02T09:41:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.036+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b0140140 con 0x7f05b00b3f80 2022-05-02T09:41:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.038+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b0069980 con 0x7f05b00b3f80 2022-05-02T09:41:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.038+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f05a0019030 con 0x7f05b00b3f80 2022-05-02T09:41:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.039+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f05a0053350 con 0x7f05b00b3f80 2022-05-02T09:41:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.039+0000 7f05b579b700 1 -- 172.21.15.50:0/4143537572 >> v1:172.21.15.50:6800/30011 conn(0x7f0590038e50 legacy=0x7f059003b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.042+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f05a0050060 con 0x7f05b00b3f80 2022-05-02T09:41:50.102 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.100+0000 7f7ac6ffd700 1 -- 172.21.15.50:0/3610466207 >> v1:172.21.15.50:6800/30011 conn(0x7f7aa8038ea0 legacy=0x7f7aa803b350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:50.126 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.123+0000 7f324dfff700 1 Processor -- start 2022-05-02T09:41:50.126 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.123+0000 7f324dfff700 1 -- start start 2022-05-02T09:41:50.127 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.125+0000 7f324dfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.127 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.125+0000 7f324dfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32480a1e80 0x7f324813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.127 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.125+0000 7f324dfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248063a90 con 0x7f324813b360 2022-05-02T09:41:50.127 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.125+0000 7f324dfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480a3900 con 0x7f32480a1e80 2022-05-02T09:41:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.125+0000 7f324dfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32480a2920 con 0x7f32480636c0 2022-05-02T09:41:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.126+0000 7f32477fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.126+0000 7f32477fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50570/0 (socket says 172.21.15.50:50570) 2022-05-02T09:41:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.126+0000 7f32477fe700 1 -- 172.21.15.50:0/3904835786 learned_addr learned my addr 172.21.15.50:0/3904835786 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.126+0000 7f3246ffd700 1 --2- 172.21.15.50:0/3904835786 >> v2:172.21.15.50:3300/0 conn(0x7f32480a1e80 0x7f324813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.127+0000 7f3246ffd700 1 -- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 msgr2=0x7f32480a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.127+0000 7f3246ffd700 1 --2- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480a33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.127+0000 7f3246ffd700 1 -- 172.21.15.50:0/3904835786 >> v1:172.21.15.50:6789/0 conn(0x7f324813b360 legacy=0x7f32480a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.127+0000 7f3246ffd700 1 -- 172.21.15.50:0/3904835786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480a0fc0 con 0x7f32480a1e80 2022-05-02T09:41:50.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.128+0000 7f3246ffd700 1 --2- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32480a1e80 0x7f324813ae20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f323c009760 tx=0x7f323c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53bf3cef11b241c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.128+0000 7f32467fc700 1 -- 172.21.15.50:0/3904835786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c011630 con 0x7f32480a1e80 2022-05-02T09:41:50.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.128+0000 7f32467fc700 1 -- 172.21.15.50:0/3904835786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c011790 con 0x7f32480a1e80 2022-05-02T09:41:50.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.128+0000 7f32467fc700 1 -- 172.21.15.50:0/3904835786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c011b50 con 0x7f32480a1e80 2022-05-02T09:41:50.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 -- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32480a1e80 msgr2=0x7f324813ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 --2- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32480a1e80 0x7f324813ae20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f323c009760 tx=0x7f323c009060 comp rx=0 tx=0).stop 2022-05-02T09:41:50.134 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 -- 172.21.15.50:0/3904835786 shutdown_connections 2022-05-02T09:41:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 --2- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 --2- 172.21.15.50:0/3904835786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32480a1e80 0x7f324813ae20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.129+0000 7f324dfff700 1 -- 172.21.15.50:0/3904835786 >> 172.21.15.50:0/3904835786 conn(0x7f3248067eb0 msgr2=0x7f3248062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.130+0000 7f324dfff700 1 -- 172.21.15.50:0/3904835786 shutdown_connections 2022-05-02T09:41:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.130+0000 7f324dfff700 1 -- 172.21.15.50:0/3904835786 wait complete. 2022-05-02T09:41:50.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.132+0000 7f324dfff700 1 Processor -- start 2022-05-02T09:41:50.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.133+0000 7f324dfff700 1 -- start start 2022-05-02T09:41:50.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f324813b360 0x7f32480ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480af400 con 0x7f324813b360 2022-05-02T09:41:50.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32480ae750 con 0x7f32480636c0 2022-05-02T09:41:50.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.134+0000 7f324dfff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32480ad1c0 con 0x7f32480a1e80 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.135+0000 7f3246ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.135+0000 7f3246ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49890/0 (socket says 172.21.15.50:49890) 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.135+0000 7f3246ffd700 1 -- 172.21.15.50:0/2527168482 learned_addr learned my addr 172.21.15.50:0/2527168482 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.135+0000 7f3247fff700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f324813b360 0x7f32480ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.135+0000 7f32477fe700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.136+0000 7f3246ffd700 1 -- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 msgr2=0x7f32480add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.136+0000 7f3246ffd700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.136+0000 7f3246ffd700 1 -- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f324813b360 msgr2=0x7f32480ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.136+0000 7f3246ffd700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f324813b360 0x7f32480ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.136+0000 7f3246ffd700 1 -- 172.21.15.50:0/2527168482 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0092a0 con 0x7f32480a1e80 2022-05-02T09:41:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.137+0000 7f3246ffd700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f32480a6080 tx=0x7f323c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.137+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c009130 con 0x7f32480a1e80 2022-05-02T09:41:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.137+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c000bc0 con 0x7f32480a1e80 2022-05-02T09:41:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.137+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c011b50 con 0x7f32480a1e80 2022-05-02T09:41:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.137+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480a9de0 con 0x7f32480a1e80 2022-05-02T09:41:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.138+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480acd30 con 0x7f32480a1e80 2022-05-02T09:41:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.140+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f323c02c030 con 0x7f32480a1e80 2022-05-02T09:41:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.140+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32480af570 con 0x7f32480a1e80 2022-05-02T09:41:50.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.141+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f323c04e450 con 0x7f32480a1e80 2022-05-02T09:41:50.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.141+0000 7f32477fe700 1 -- 172.21.15.50:0/2527168482 >> v1:172.21.15.50:6800/30011 conn(0x7f3228038e50 legacy=0x7f322803b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.147+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f323c003710 con 0x7f32480a1e80 2022-05-02T09:41:50.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.154+0000 7fee4f39d700 1 Processor -- start 2022-05-02T09:41:50.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.154+0000 7fee4f39d700 1 -- start start 2022-05-02T09:41:50.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.155+0000 7fee4f39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 0x7fee4813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.155+0000 7fee4f39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee4813b1d0 0x7fee481481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.155+0000 7fee4f39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480b4350 con 0x7fee4813e280 2022-05-02T09:41:50.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.155+0000 7fee4f39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee480a4440 con 0x7fee4813b1d0 2022-05-02T09:41:50.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.155+0000 7fee4f39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee4813d8a0 con 0x7fee480b3f80 2022-05-02T09:41:50.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.156+0000 7fee4e39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 0x7fee4813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.156+0000 7fee4e39b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 0x7fee4813dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49892/0 (socket says 172.21.15.50:49892) 2022-05-02T09:41:50.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.156+0000 7fee4e39b700 1 -- 172.21.15.50:0/2719106040 learned_addr learned my addr 172.21.15.50:0/2719106040 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.156+0000 7fee4eb9c700 1 --2- 172.21.15.50:0/2719106040 >> v2:172.21.15.50:3300/0 conn(0x7fee4813b1d0 0x7fee481481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.157+0000 7fee4eb9c700 1 -- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 msgr2=0x7fee4813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:50.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.157+0000 7fee4eb9c700 1 --2- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 0x7fee4813dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.157+0000 7fee4eb9c700 1 -- 172.21.15.50:0/2719106040 >> v1:172.21.15.50:6789/0 conn(0x7fee4813e280 legacy=0x7fee4813aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.157+0000 7fee4eb9c700 1 -- 172.21.15.50:0/2719106040 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4813e710 con 0x7fee4813b1d0 2022-05-02T09:41:50.160 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.158+0000 7fee4eb9c700 1 --2- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4813b1d0 0x7fee481481d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee40009e60 tx=0x7fee40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f459772269fcd84 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.158+0000 7fee4d399700 1 -- 172.21.15.50:0/2719106040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000e070 con 0x7fee4813b1d0 2022-05-02T09:41:50.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.158+0000 7fee4d399700 1 -- 172.21.15.50:0/2719106040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000bbf0 con 0x7fee4813b1d0 2022-05-02T09:41:50.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4d399700 1 -- 172.21.15.50:0/2719106040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40012430 con 0x7fee4813b1d0 2022-05-02T09:41:50.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 -- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4813b1d0 msgr2=0x7fee481481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 --2- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4813b1d0 0x7fee481481d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee40009e60 tx=0x7fee40009780 comp rx=0 tx=0).stop 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 -- 172.21.15.50:0/2719106040 shutdown_connections 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 --2- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4813b1d0 0x7fee481481d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 --2- 172.21.15.50:0/2719106040 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee480b3f80 0x7fee4813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.159+0000 7fee4f39d700 1 -- 172.21.15.50:0/2719106040 >> 172.21.15.50:0/2719106040 conn(0x7fee48069580 msgr2=0x7fee480674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.160+0000 7fee4f39d700 1 -- 172.21.15.50:0/2719106040 shutdown_connections 2022-05-02T09:41:50.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.160+0000 7fee4f39d700 1 -- 172.21.15.50:0/2719106040 wait complete. 2022-05-02T09:41:50.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.160+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ac809b1f0 con 0x7f7ac8142dd0 2022-05-02T09:41:50.164 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.161+0000 7f7aaeffd700 1 -- 172.21.15.50:0/3610466207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ac0032c10 con 0x7f7ac8142dd0 2022-05-02T09:41:50.164 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:50.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.162+0000 7fee4f39d700 1 Processor -- start 2022-05-02T09:41:50.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.162+0000 7fee4f39d700 1 -- start start 2022-05-02T09:41:50.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee480b3f80 0x7fee481397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee4813e280 0x7fee4814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4813a130 con 0x7fee480b3f80 2022-05-02T09:41:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4814d980 con 0x7fee4813e280 2022-05-02T09:41:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.163+0000 7fee4f39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee4813f9d0 con 0x7fee4813b1d0 2022-05-02T09:41:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.164+0000 7fee4db9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.164+0000 7fee4e39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee480b3f80 0x7fee481397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.164+0000 7fee4db9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49894/0 (socket says 172.21.15.50:49894) 2022-05-02T09:41:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.164+0000 7fee4db9a700 1 -- 172.21.15.50:0/4078942035 learned_addr learned my addr 172.21.15.50:0/4078942035 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.164+0000 7fee4eb9c700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee4813e280 0x7fee4814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.165+0000 7fee4db9a700 1 -- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee4813e280 msgr2=0x7fee4814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.165+0000 7fee4db9a700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee4813e280 0x7fee4814ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.165+0000 7fee4db9a700 1 -- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee480b3f80 msgr2=0x7fee481397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.165+0000 7fee4db9a700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee480b3f80 0x7fee481397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.165+0000 7fee4db9a700 1 -- 172.21.15.50:0/4078942035 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40009a20 con 0x7fee4813b1d0 2022-05-02T09:41:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee4db9a700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c440 tx=0x7fee38007da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380050d0 con 0x7fee4813b1d0 2022-05-02T09:41:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38005230 con 0x7fee4813b1d0 2022-05-02T09:41:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4813f540 con 0x7fee4813b1d0 2022-05-02T09:41:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38003710 con 0x7fee4813b1d0 2022-05-02T09:41:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.166+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee48140380 con 0x7fee4813b1d0 2022-05-02T09:41:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.168+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee480b4a30 con 0x7fee4813b1d0 2022-05-02T09:41:50.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.168+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7fee38019030 con 0x7fee4813b1d0 2022-05-02T09:41:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 >> v1:172.21.15.50:6800/30011 conn(0x7f7aa8038ea0 legacy=0x7f7aa803b350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 msgr2=0x7f7ac8141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000c790 tx=0x7f7ac0001540 comp rx=0 tx=0).stop 2022-05-02T09:41:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fee38049ec0 con 0x7fee4813b1d0 2022-05-02T09:41:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 shutdown_connections 2022-05-02T09:41:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8142dd0 0x7f7ac8141d30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7ac80a0ca0 0x7f7ac8099f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 --2- 172.21.15.50:0/3610466207 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7ac80a1e80 0x7f7ac81417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 >> 172.21.15.50:0/3610466207 conn(0x7f7ac8062df0 msgr2=0x7f7ac806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.169+0000 7fee4e39b700 1 -- 172.21.15.50:0/4078942035 >> v1:172.21.15.50:6800/30011 conn(0x7fee28038e50 legacy=0x7fee2803b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.170+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 shutdown_connections 2022-05-02T09:41:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.170+0000 7f7acd3ff700 1 -- 172.21.15.50:0/3610466207 wait complete. 2022-05-02T09:41:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.173+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7fee3802ecb0 con 0x7fee4813b1d0 2022-05-02T09:41:50.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.2 2022-05-02T09:41:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.210+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05b013d2f0 con 0x7f05b00b3f80 2022-05-02T09:41:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.211+0000 7f059d7fa700 1 -- 172.21.15.50:0/4143537572 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05a0050070 con 0x7f05b00b3f80 2022-05-02T09:41:50.213 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.213+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 >> v1:172.21.15.50:6800/30011 conn(0x7f0590038e50 legacy=0x7f059003b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.213+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 msgr2=0x7f05b00a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.213+0000 7f05b679d700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 0x7f05b00a1810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05b00a8fc0 tx=0x7f05a0009060 comp rx=0 tx=0).stop 2022-05-02T09:41:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 shutdown_connections 2022-05-02T09:41:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f05b013e280 0x7f05b009f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b00a9a80 0x7f05b00a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 --2- 172.21.15.50:0/4143537572 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f05b00b3f80 0x7f05b00a1810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 >> 172.21.15.50:0/4143537572 conn(0x7f05b0069580 msgr2=0x7f05b00a4600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 shutdown_connections 2022-05-02T09:41:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.214+0000 7f05b679d700 1 -- 172.21.15.50:0/4143537572 wait complete. 2022-05-02T09:41:50.234 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:50.232+0000 7f3cc1ad2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-05-02T09:41:50.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.1 2022-05-02T09:41:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.316+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee4813bb40 con 0x7fee4813b1d0 2022-05-02T09:41:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.317+0000 7fee367fc700 1 -- 172.21.15.50:0/4078942035 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee38017070 con 0x7fee4813b1d0 2022-05-02T09:41:50.320 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.319+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 >> v1:172.21.15.50:6800/30011 conn(0x7fee28038e50 legacy=0x7fee2803b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.319+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 msgr2=0x7fee4813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.319+0000 7fee4f39d700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c440 tx=0x7fee38007da0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 shutdown_connections 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee4813e280 0x7fee4814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee480b3f80 0x7fee481397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 --2- 172.21.15.50:0/4078942035 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fee4813b1d0 0x7fee4813f000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 >> 172.21.15.50:0/4078942035 conn(0x7fee48069580 msgr2=0x7fee4813cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 shutdown_connections 2022-05-02T09:41:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.320+0000 7fee4f39d700 1 -- 172.21.15.50:0/4078942035 wait complete. 2022-05-02T09:41:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.342+0000 7f32477fe700 1 -- 172.21.15.50:0/2527168482 >> v1:172.21.15.50:6800/30011 conn(0x7f3228038e50 legacy=0x7f322803b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:50.360 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:50.357+0000 7f3cc1ad2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-05-02T09:41:50.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.0 2022-05-02T09:41:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.383+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f324804bfb0 con 0x7f32480a1e80 2022-05-02T09:41:50.386 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.383+0000 7f322f7fe700 1 -- 172.21.15.50:0/2527168482 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f323c02a030 con 0x7f32480a1e80 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 >> v1:172.21.15.50:6800/30011 conn(0x7f3228038e50 legacy=0x7f322803b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 msgr2=0x7f32480aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f32480a6080 tx=0x7f323c017000 comp rx=0 tx=0).stop 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 shutdown_connections 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f324813b360 0x7f32480ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f32480636c0 0x7f32480add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 --2- 172.21.15.50:0/2527168482 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f32480a1e80 0x7f32480aeec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 >> 172.21.15.50:0/2527168482 conn(0x7f3248067eb0 msgr2=0x7f32480b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 shutdown_connections 2022-05-02T09:41:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:50.385+0000 7f324dfff700 1 -- 172.21.15.50:0/2527168482 wait complete. 2022-05-02T09:41:50.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2022-05-02T09:41:50.587 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:50.585+0000 7fe919806000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-05-02T09:41:50.666 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:50.664+0000 7f3cc1ad2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-05-02T09:41:51.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:41:51.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:41:51.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:41:51.375 INFO:tasks.ceph.mgr.y.smithi050.stderr:2022-05-02T09:41:51.373+0000 7f3cc1ad2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-05-02T09:41:51.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:41:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.454+0000 7f2706f9d700 1 Processor -- start 2022-05-02T09:41:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.454+0000 7f2706f9d700 1 -- start start 2022-05-02T09:41:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2706f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 0x7f270013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2706f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f270013e280 0x7f270013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2706f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27000b4350 con 0x7f27000a9a80 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2706f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000a4440 con 0x7f270013e280 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2706f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270013d8a0 con 0x7f27000b3f80 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f270679c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27000a9a80 0x7f2700140e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52348/0 (socket says 172.21.15.50:52348) 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f270679c700 1 -- 172.21.15.50:0/942569283 learned_addr learned my addr 172.21.15.50:0/942569283 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f270579a700 1 --2- 172.21.15.50:0/942569283 >> v2:172.21.15.50:3300/0 conn(0x7f270013e280 0x7f270013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.456+0000 7f2705f9b700 1 --2- 172.21.15.50:0/942569283 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 0x7f270013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2704f99700 1 -- 172.21.15.50:0/942569283 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025766642 0 0) 0x7f27000b4350 con 0x7f27000a9a80 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2704f99700 1 -- 172.21.15.50:0/942569283 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e80033f0 con 0x7f27000a9a80 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2705f9b700 1 -- 172.21.15.50:0/942569283 >> v2:172.21.15.50:3300/0 conn(0x7f270013e280 msgr2=0x7f270013aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2705f9b700 1 --2- 172.21.15.50:0/942569283 >> v2:172.21.15.50:3300/0 conn(0x7f270013e280 0x7f270013aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2705f9b700 1 -- 172.21.15.50:0/942569283 >> v1:172.21.15.50:6789/0 conn(0x7f27000a9a80 legacy=0x7f2700140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.457+0000 7f2705f9b700 1 -- 172.21.15.50:0/942569283 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270013e710 con 0x7f27000b3f80 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.458+0000 7f2705f9b700 1 --2- 172.21.15.50:0/942569283 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 0x7f270013dd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009760 tx=0x7f26fc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5a45206f77d08b7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.458+0000 7f2704f99700 1 -- 172.21.15.50:0/942569283 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011630 con 0x7f27000b3f80 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.458+0000 7f2704f99700 1 -- 172.21.15.50:0/942569283 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc011790 con 0x7f27000b3f80 2022-05-02T09:41:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.458+0000 7f2704f99700 1 -- 172.21.15.50:0/942569283 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011b30 con 0x7f27000b3f80 2022-05-02T09:41:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 -- 172.21.15.50:0/942569283 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 msgr2=0x7f270013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 --2- 172.21.15.50:0/942569283 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 0x7f270013dd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009760 tx=0x7f26fc009060 comp rx=0 tx=0).stop 2022-05-02T09:41:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 -- 172.21.15.50:0/942569283 shutdown_connections 2022-05-02T09:41:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 --2- 172.21.15.50:0/942569283 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f27000b3f80 0x7f270013dd40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 --2- 172.21.15.50:0/942569283 >> v2:172.21.15.50:3300/0 conn(0x7f270013e280 0x7f270013aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 -- 172.21.15.50:0/942569283 >> 172.21.15.50:0/942569283 conn(0x7f2700069580 msgr2=0x7f27000674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 -- 172.21.15.50:0/942569283 shutdown_connections 2022-05-02T09:41:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.459+0000 7f2706f9d700 1 -- 172.21.15.50:0/942569283 wait complete. 2022-05-02T09:41:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.461+0000 7f2706f9d700 1 Processor -- start 2022-05-02T09:41:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.461+0000 7f2706f9d700 1 -- start start 2022-05-02T09:41:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 0x7f27001412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 0x7f2700150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f270013e280 0x7f2700136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001511f0 con 0x7f27000b3f80 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700141ce0 con 0x7f27000a9a80 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.462+0000 7f2706f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27001513e0 con 0x7f270013e280 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.463+0000 7f2705f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 0x7f27001412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.463+0000 7f270579a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 0x7f2700150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.463+0000 7f2705f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 0x7f27001412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50576/0 (socket says 172.21.15.50:50576) 2022-05-02T09:41:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.463+0000 7f2705f9b700 1 -- 172.21.15.50:0/3252874658 learned_addr learned my addr 172.21.15.50:0/3252874658 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.463+0000 7f270679c700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f270013e280 0x7f2700136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 -- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f270013e280 msgr2=0x7f2700136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f270013e280 0x7f2700136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 -- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 msgr2=0x7f27001412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 0x7f27001412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 -- 172.21.15.50:0/3252874658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0092a0 con 0x7f27000b3f80 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.464+0000 7f270579a700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 0x7f2700150cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27000a8fc0 tx=0x7f26f0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.465+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0013680 con 0x7f27000b3f80 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.465+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00137e0 con 0x7f27000b3f80 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.465+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0013b80 con 0x7f27000b3f80 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.465+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2700151680 con 0x7f27000b3f80 2022-05-02T09:41:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.465+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270013f030 con 0x7f27000b3f80 2022-05-02T09:41:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.467+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700069980 con 0x7f27000b3f80 2022-05-02T09:41:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.468+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7f26f0023070 con 0x7f27000b3f80 2022-05-02T09:41:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.468+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f26f004b1c0 con 0x7f27000b3f80 2022-05-02T09:41:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.468+0000 7f2705f9b700 1 -- 172.21.15.50:0/3252874658 >> v1:172.21.15.50:6800/30011 conn(0x7f26e0038e50 legacy=0x7f26e003b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.473+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f26f00337e0 con 0x7f27000b3f80 2022-05-02T09:41:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.525+0000 7fe36a5ff700 1 Processor -- start 2022-05-02T09:41:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.525+0000 7fe36a5ff700 1 -- start start 2022-05-02T09:41:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.526+0000 7fe36a5ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.526+0000 7fe36a5ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe364140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.526+0000 7fe36a5ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640a9310 con 0x7fe36413dfe0 2022-05-02T09:41:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.526+0000 7fe36a5ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640a90a0 con 0x7fe3640a9830 2022-05-02T09:41:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.526+0000 7fe36a5ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640a7fe0 con 0x7fe36413e790 2022-05-02T09:41:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50578/0 (socket says 172.21.15.50:50578) 2022-05-02T09:41:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 -- 172.21.15.50:0/1586870573 learned_addr learned my addr 172.21.15.50:0/1586870573 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe3637fe700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe364140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 -- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 msgr2=0x7fe364140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe364140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.527+0000 7fe363fff700 1 -- 172.21.15.50:0/1586870573 >> v1:172.21.15.50:6789/0 conn(0x7fe36413dfe0 legacy=0x7fe364141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.528+0000 7fe363fff700 1 -- 172.21.15.50:0/1586870573 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640a8280 con 0x7fe3640a9830 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.528+0000 7fe363fff700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe354009830 tx=0x7fe3540090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5baaaeffd6e4faa0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.529+0000 7fe362ffd700 1 -- 172.21.15.50:0/1586870573 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354004030 con 0x7fe3640a9830 2022-05-02T09:41:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.529+0000 7fe362ffd700 1 -- 172.21.15.50:0/1586870573 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354004190 con 0x7fe3640a9830 2022-05-02T09:41:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.529+0000 7fe362ffd700 1 -- 172.21.15.50:0/1586870573 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354011630 con 0x7fe3640a9830 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.529+0000 7fe36a5ff700 1 -- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 msgr2=0x7fe3640a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.529+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe354009830 tx=0x7fe3540090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 -- 172.21.15.50:0/1586870573 shutdown_connections 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3640a9830 0x7fe3640a5800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/1586870573 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe364140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 -- 172.21.15.50:0/1586870573 >> 172.21.15.50:0/1586870573 conn(0x7fe364062df0 msgr2=0x7fe3640631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 -- 172.21.15.50:0/1586870573 shutdown_connections 2022-05-02T09:41:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.530+0000 7fe36a5ff700 1 -- 172.21.15.50:0/1586870573 wait complete. 2022-05-02T09:41:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.532+0000 7fe36a5ff700 1 Processor -- start 2022-05-02T09:41:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.532+0000 7fe36a5ff700 1 -- start start 2022-05-02T09:41:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe36413dfe0 0x7fe364150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe36414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640afc70 con 0x7fe3640a9830 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640aff30 con 0x7fe36413dfe0 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.533+0000 7fe36a5ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640ad8f0 con 0x7fe36413e790 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.534+0000 7fe363fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.534+0000 7fe363fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36028/0 (socket says 172.21.15.50:36028) 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.534+0000 7fe363fff700 1 -- 172.21.15.50:0/2704545551 learned_addr learned my addr 172.21.15.50:0/2704545551 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.534+0000 7fe368b9c700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe36414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.534+0000 7fe3637fe700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe36413dfe0 0x7fe364150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 -- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 msgr2=0x7fe36414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe36414d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 -- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe36413dfe0 msgr2=0x7fe364150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe36413dfe0 0x7fe364150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 -- 172.21.15.50:0/2704545551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354009370 con 0x7fe3640a9830 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.535+0000 7fe363fff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe354004000 tx=0x7fe354016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.536+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540036f0 con 0x7fe3640a9830 2022-05-02T09:41:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.536+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354003850 con 0x7fe3640a9830 2022-05-02T09:41:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.536+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354003c10 con 0x7fe3640a9830 2022-05-02T09:41:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.536+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640b1430 con 0x7fe3640a9830 2022-05-02T09:41:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.536+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe364151340 con 0x7fe3640a9830 2022-05-02T09:41:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.537+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 41878+0+0 (secure 0 0 0) 0x7fe354017020 con 0x7fe3640a9830 2022-05-02T09:41:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.538+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3640b1620 con 0x7fe3640a9830 2022-05-02T09:41:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.538+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fe35404c720 con 0x7fe3640a9830 2022-05-02T09:41:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.538+0000 7fe3637fe700 1 -- 172.21.15.50:0/2704545551 >> v1:172.21.15.50:6800/30011 conn(0x7fe344038e50 legacy=0x7fe34403b300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/30011 2022-05-02T09:41:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.544+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7fe35400a790 con 0x7fe3640a9830 2022-05-02T09:41:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.570+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 6) v1 ==== 52609+0+0 (secure 0 0 0) 0x7f26f0019030 con 0x7f27000b3f80 2022-05-02T09:41:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.571+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 >> v1:172.21.15.50:6800/30011 conn(0x7f26e0038e50 legacy=0x7f26e003b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.571+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 6) v1 ==== 52609+0+0 (secure 0 0 0) 0x7fe35400f050 con 0x7fe3640a9830 2022-05-02T09:41:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.572+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 >> v1:172.21.15.50:6800/30011 conn(0x7fe344038e50 legacy=0x7fe34403b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.664+0000 7f1c98f9d700 1 Processor -- start 2022-05-02T09:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.664+0000 7f1c98f9d700 1 -- start start 2022-05-02T09:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c98f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 0x7f1c940a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c98f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c98f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9406f110 con 0x7f1c940b02c0 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c98f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c940b0690 con 0x7f1c9413dd40 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c98f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9413e1d0 con 0x7f1c9406f540 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c92ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 0x7f1c940a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49920/0 (socket says 172.21.15.50:49920) 2022-05-02T09:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c92ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 0x7f1c940a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36046/0 (socket says 172.21.15.50:36046) 2022-05-02T09:41:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.666+0000 7f1c93fff700 1 -- 172.21.15.50:0/664008259 learned_addr learned my addr 172.21.15.50:0/664008259 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.667+0000 7f1c93fff700 1 -- 172.21.15.50:0/664008259 >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 msgr2=0x7f1c940a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.667+0000 7f1c93fff700 1 --2- 172.21.15.50:0/664008259 >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 0x7f1c940a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.667+0000 7f1c93fff700 1 -- 172.21.15.50:0/664008259 >> v1:172.21.15.50:6789/0 conn(0x7f1c940b02c0 legacy=0x7f1c940a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.667+0000 7f1c93fff700 1 -- 172.21.15.50:0/664008259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9413e470 con 0x7f1c9406f540 2022-05-02T09:41:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.668+0000 7f1c93fff700 1 --2- 172.21.15.50:0/664008259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009f20 tx=0x7f1c8c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47cbfcd22357daf2 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.668+0000 7f1c927fc700 1 -- 172.21.15.50:0/664008259 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00e070 con 0x7f1c9406f540 2022-05-02T09:41:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.669+0000 7f1c927fc700 1 -- 172.21.15.50:0/664008259 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00b9d0 con 0x7f1c9406f540 2022-05-02T09:41:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.669+0000 7f1c927fc700 1 -- 172.21.15.50:0/664008259 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0092e0 con 0x7f1c9406f540 2022-05-02T09:41:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 -- 172.21.15.50:0/664008259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 msgr2=0x7f1c941450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/664008259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009f20 tx=0x7f1c8c009840 comp rx=0 tx=0).stop 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 -- 172.21.15.50:0/664008259 shutdown_connections 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/664008259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c941450e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/664008259 >> v2:172.21.15.50:3300/0 conn(0x7f1c9413dd40 0x7f1c940a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 -- 172.21.15.50:0/664008259 >> 172.21.15.50:0/664008259 conn(0x7f1c940638c0 msgr2=0x7f1c940af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 -- 172.21.15.50:0/664008259 shutdown_connections 2022-05-02T09:41:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.670+0000 7f1c98f9d700 1 -- 172.21.15.50:0/664008259 wait complete. 2022-05-02T09:41:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.672+0000 7f1c98f9d700 1 Processor -- start 2022-05-02T09:41:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.673+0000 7f1c98f9d700 1 -- start start 2022-05-02T09:41:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c940a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c940b02c0 0x7f1c940a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 0x7f1c94151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940a95c0 con 0x7f1c940b02c0 2022-05-02T09:41:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940a5440 con 0x7f1c9413dd40 2022-05-02T09:41:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.674+0000 7f1c98f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940a56a0 con 0x7f1c9406f540 2022-05-02T09:41:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.675+0000 7f1c937fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c940a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.675+0000 7f1c937fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c940a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49926/0 (socket says 172.21.15.50:49926) 2022-05-02T09:41:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.675+0000 7f1c937fe700 1 -- 172.21.15.50:0/2253310523 learned_addr learned my addr 172.21.15.50:0/2253310523 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 0x7f1c94151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 -- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 msgr2=0x7f1c940a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c940a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 -- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c940b02c0 msgr2=0x7f1c940a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c940b02c0 0x7f1c940a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.676+0000 7f1c93fff700 1 -- 172.21.15.50:0/2253310523 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c009ae0 con 0x7f1c9413dd40 2022-05-02T09:41:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.677+0000 7f1c93fff700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 0x7f1c94151130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c015000 tx=0x7f1c8c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.678+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0094e0 con 0x7f1c9413dd40 2022-05-02T09:41:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.678+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c003e00 con 0x7f1c9413dd40 2022-05-02T09:41:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.678+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c004480 con 0x7f1c9413dd40 2022-05-02T09:41:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.678+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c940a7050 con 0x7f1c9413dd40 2022-05-02T09:41:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.678+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c940a8410 con 0x7f1c9413dd40 2022-05-02T09:41:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.680+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94067630 con 0x7f1c9413dd40 2022-05-02T09:41:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.681+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 6) v1 ==== 52609+0+0 (secure 0 0 0) 0x7f1c8c01c410 con 0x7f1c9413dd40 2022-05-02T09:41:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.681+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f1c8c05af90 con 0x7f1c9413dd40 2022-05-02T09:41:51.685 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.682+0000 7fe8e0f52700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.685 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.682+0000 7fe8e0f52700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.685 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.682+0000 7fe8e0f52700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.685 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.682+0000 7fe8e0f52700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.685 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.682+0000 7fe8e0f52700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.686 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.683+0000 7fe8def4e700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.686 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.683+0000 7fe8def4e700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.686 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.683+0000 7fe8def4e700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.686 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.683+0000 7fe8def4e700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.686 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T09:41:51.683+0000 7fe8def4e700 -1 client.0 error registering admin socket command: (17) File exists 2022-05-02T09:41:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.689+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7f1c8c026120 con 0x7f1c9413dd40 2022-05-02T09:41:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.701+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f270013cd80 con 0x7f27000b3f80 2022-05-02T09:41:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.702+0000 7f26edffb700 1 -- 172.21.15.50:0/3252874658 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26f00335b0 con 0x7f27000b3f80 2022-05-02T09:41:51.705 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 msgr2=0x7f2700150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 0x7f2700150cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27000a8fc0 tx=0x7f26f0009060 comp rx=0 tx=0).stop 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 shutdown_connections 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f270013e280 0x7f2700136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27000a9a80 0x7f27001412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 --2- 172.21.15.50:0/3252874658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27000b3f80 0x7f2700150cb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 >> 172.21.15.50:0/3252874658 conn(0x7f2700069580 msgr2=0x7f270013cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 shutdown_connections 2022-05-02T09:41:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.704+0000 7f2706f9d700 1 -- 172.21.15.50:0/3252874658 wait complete. 2022-05-02T09:41:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.711+0000 7fc21af9d700 1 Processor -- start 2022-05-02T09:41:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.711+0000 7fc21af9d700 1 -- start start 2022-05-02T09:41:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.712+0000 7fc21af9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.712+0000 7fc21af9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2140a9bf0 0x7fc214148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.712+0000 7fc21af9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc214140ff0 con 0x7fc2141419c0 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.712+0000 7fc21af9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc214063a90 con 0x7fc2140636c0 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.712+0000 7fc21af9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140a9200 con 0x7fc2140a9bf0 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc219f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc219f9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50608/0 (socket says 172.21.15.50:50608) 2022-05-02T09:41:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc219f9b700 1 -- 172.21.15.50:0/3445821638 learned_addr learned my addr 172.21.15.50:0/3445821638 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc21a79c700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2140a9bf0 0x7fc214148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc219f9b700 1 -- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2140a9bf0 msgr2=0x7fc214148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.713+0000 7fc219f9b700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2140a9bf0 0x7fc214148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc219f9b700 1 -- 172.21.15.50:0/3445821638 >> v1:172.21.15.50:6789/0 conn(0x7fc2141419c0 legacy=0x7fc21413e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc219f9b700 1 -- 172.21.15.50:0/3445821638 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214141e50 con 0x7fc2140636c0 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc219f9b700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc210009830 tx=0x7fc2100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3614ea0c56034cb server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc218f99700 1 -- 172.21.15.50:0/3445821638 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210011630 con 0x7fc2140636c0 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc218f99700 1 -- 172.21.15.50:0/3445821638 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2100117b0 con 0x7fc2140636c0 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.714+0000 7fc218f99700 1 -- 172.21.15.50:0/3445821638 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210011b70 con 0x7fc2140636c0 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 -- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 msgr2=0x7fc214141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc210009830 tx=0x7fc2100090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 -- 172.21.15.50:0/3445821638 shutdown_connections 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2140a9bf0 0x7fc214148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 --2- 172.21.15.50:0/3445821638 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140636c0 0x7fc214141480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 -- 172.21.15.50:0/3445821638 >> 172.21.15.50:0/3445821638 conn(0x7fc214069370 msgr2=0x7fc214062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.715+0000 7fc21af9d700 1 -- 172.21.15.50:0/3445821638 shutdown_connections 2022-05-02T09:41:51.720 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.716+0000 7fc21af9d700 1 -- 172.21.15.50:0/3445821638 wait complete. 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.717+0000 7fc21af9d700 1 Processor -- start 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.717+0000 7fc21af9d700 1 -- start start 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2140636c0 0x7fc21414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140a9bf0 0x7fc214096a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21414ddd0 con 0x7fc2140636c0 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21414df90 con 0x7fc2140a9bf0 2022-05-02T09:41:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.718+0000 7fc21af9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc214096f50 con 0x7fc2141419c0 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49936/0 (socket says 172.21.15.50:49936) 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 -- 172.21.15.50:0/1590836967 learned_addr learned my addr 172.21.15.50:0/1590836967 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc219f9b700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2140636c0 0x7fc21414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21979a700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140a9bf0 0x7fc214096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 -- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140a9bf0 msgr2=0x7fc214096a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140a9bf0 0x7fc214096a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 -- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2140636c0 msgr2=0x7fc21414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2140636c0 0x7fc21414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.719+0000 7fc21a79c700 1 -- 172.21.15.50:0/1590836967 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009370 con 0x7fc2141419c0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.720+0000 7fc21a79c700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009ef0 tx=0x7fc20c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.720+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00cb70 con 0x7fc2141419c0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.720+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00f040 con 0x7fc2141419c0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.720+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c014480 con 0x7fc2141419c0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.720+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2140aff80 con 0x7fc2141419c0 2022-05-02T09:41:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.721+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2140b1070 con 0x7fc2141419c0 2022-05-02T09:41:51.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.722+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2140af1c0 con 0x7fc2141419c0 2022-05-02T09:41:51.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.722+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 6) v1 ==== 52609+0+0 (secure 0 0 0) 0x7fc20c014830 con 0x7fc2141419c0 2022-05-02T09:41:51.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.723+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fc20c062350 con 0x7fc2141419c0 2022-05-02T09:41:51.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.727+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111264 (secure 0 0 0) 0x7fc20c05f060 con 0x7fc2141419c0 2022-05-02T09:41:51.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.2 2022-05-02T09:41:51.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.760+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe36404bfb0 con 0x7fe3640a9830 2022-05-02T09:41:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.760+0000 7fe34bfff700 1 -- 172.21.15.50:0/2704545551 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe35401e270 con 0x7fe3640a9830 2022-05-02T09:41:51.763 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 msgr2=0x7fe3640ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe354004000 tx=0x7fe354016000 comp rx=0 tx=0).stop 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 shutdown_connections 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe36413e790 0x7fe36414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640a9830 0x7fe3640ad3b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 --2- 172.21.15.50:0/2704545551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe36413dfe0 0x7fe364150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 >> 172.21.15.50:0/2704545551 conn(0x7fe364062df0 msgr2=0x7fe36413aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 shutdown_connections 2022-05-02T09:41:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.763+0000 7fe36a5ff700 1 -- 172.21.15.50:0/2704545551 wait complete. 2022-05-02T09:41:51.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.1 2022-05-02T09:41:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.836+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c940afee0 con 0x7f1c9413dd40 2022-05-02T09:41:51.840 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.837+0000 7f1c7b7fe700 1 -- 172.21.15.50:0/2253310523 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c8c029070 con 0x7f1c9413dd40 2022-05-02T09:41:51.840 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:51.841 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 msgr2=0x7f1c94151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 0x7f1c94151130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c015000 tx=0x7f1c8c018000 comp rx=0 tx=0).stop 2022-05-02T09:41:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 shutdown_connections 2022-05-02T09:41:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f1c9406f540 0x7f1c940a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c9413dd40 0x7f1c94151130 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 --2- 172.21.15.50:0/2253310523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c940b02c0 0x7f1c940a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 >> 172.21.15.50:0/2253310523 conn(0x7f1c940638c0 msgr2=0x7f1c9413c290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 shutdown_connections 2022-05-02T09:41:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.839+0000 7f1c98f9d700 1 -- 172.21.15.50:0/2253310523 wait complete. 2022-05-02T09:41:51.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.0 2022-05-02T09:41:51.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.884+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2140a6ca0 con 0x7fc2141419c0 2022-05-02T09:41:51.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.884+0000 7fc201ffb700 1 -- 172.21.15.50:0/1590836967 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc20c018090 con 0x7fc2141419c0 2022-05-02T09:41:51.887 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 msgr2=0x7fc2140ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009ef0 tx=0x7fc20c00b040 comp rx=0 tx=0).stop 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 shutdown_connections 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fc2141419c0 0x7fc2140ad790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2140636c0 0x7fc21414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 --2- 172.21.15.50:0/1590836967 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2140a9bf0 0x7fc214096a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 >> 172.21.15.50:0/1590836967 conn(0x7fc214069370 msgr2=0x7fc21413ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 shutdown_connections 2022-05-02T09:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:51.886+0000 7fc21af9d700 1 -- 172.21.15.50:0/1590836967 wait complete. 2022-05-02T09:41:51.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2022-05-02T09:41:52.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:41:52.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:41:52.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:41:52.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:41:52.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.975+0000 7feba279d700 1 Processor -- start 2022-05-02T09:41:52.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.976+0000 7feba279d700 1 -- start start 2022-05-02T09:41:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.976+0000 7feba279d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb9c0636c0 0x7feb9c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.976+0000 7feba279d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:52.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba279d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c140ff0 con 0x7feb9c1419c0 2022-05-02T09:41:52.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba279d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c063a90 con 0x7feb9c0636c0 2022-05-02T09:41:52.980 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba279d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0a9200 con 0x7feb9c0a9bf0 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba179b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb9c0636c0 0x7feb9c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba179b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb9c0636c0 0x7feb9c141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36060/0 (socket says 172.21.15.50:36060) 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba0f9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb9c1419c0 0x7feb9c13e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52356/0 (socket says 172.21.15.50:52356) 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba179b700 1 -- 172.21.15.50:0/3430364104 learned_addr learned my addr 172.21.15.50:0/3430364104 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.977+0000 7feba1f9c700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feba179b700 1 -- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 msgr2=0x7feb9c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feba179b700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feba179b700 1 -- 172.21.15.50:0/3430364104 >> v1:172.21.15.50:6789/0 conn(0x7feb9c1419c0 legacy=0x7feb9c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feba179b700 1 -- 172.21.15.50:0/3430364104 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c141e50 con 0x7feb9c0636c0 2022-05-02T09:41:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feb8bfff700 1 -- 172.21.15.50:0/3430364104 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299694851 0 0) 0x7feb9c140ff0 con 0x7feb9c1419c0 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.978+0000 7feba179b700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c141480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb98006fd0 tx=0x7feb980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab2fc7a2f3c22 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.979+0000 7feb8bfff700 1 -- 172.21.15.50:0/3430364104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98004030 con 0x7feb9c0636c0 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.979+0000 7feb8bfff700 1 -- 172.21.15.50:0/3430364104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98004190 con 0x7feb9c0636c0 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.979+0000 7feb8bfff700 1 -- 172.21.15.50:0/3430364104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800b690 con 0x7feb9c0636c0 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.979+0000 7feba279d700 1 -- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 msgr2=0x7feb9c141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.979+0000 7feba279d700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c141480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb98006fd0 tx=0x7feb980090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 -- 172.21.15.50:0/3430364104 shutdown_connections 2022-05-02T09:41:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 --2- 172.21.15.50:0/3430364104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c141480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 -- 172.21.15.50:0/3430364104 >> 172.21.15.50:0/3430364104 conn(0x7feb9c069370 msgr2=0x7feb9c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 -- 172.21.15.50:0/3430364104 shutdown_connections 2022-05-02T09:41:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.980+0000 7feba279d700 1 -- 172.21.15.50:0/3430364104 wait complete. 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.981+0000 7feba279d700 1 Processor -- start 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.981+0000 7feba279d700 1 -- start start 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feb9c1419c0 0x7feb9c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c06b7b0 con 0x7feb9c0636c0 2022-05-02T09:41:52.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c06c9d0 con 0x7feb9c1419c0 2022-05-02T09:41:52.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.982+0000 7feba279d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c06c670 con 0x7feb9c0a9bf0 2022-05-02T09:41:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.983+0000 7feba179b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.983+0000 7feba179b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36062/0 (socket says 172.21.15.50:36062) 2022-05-02T09:41:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.983+0000 7feba179b700 1 -- 172.21.15.50:0/1631999992 learned_addr learned my addr 172.21.15.50:0/1631999992 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.983+0000 7feba1f9c700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feb9c1419c0 0x7feb9c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.983+0000 7feba0f9a700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 -- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 msgr2=0x7feb9c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 -- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feb9c1419c0 msgr2=0x7feb9c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feb9c1419c0 0x7feb9c155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 -- 172.21.15.50:0/1631999992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009370 con 0x7feb9c0636c0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feba179b700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb9c063bd0 tx=0x7feb98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980036f0 con 0x7feb9c0636c0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.984+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98003850 con 0x7feb9c0636c0 2022-05-02T09:41:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.985+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c06d6a0 con 0x7feb9c0636c0 2022-05-02T09:41:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.985+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98003bf0 con 0x7feb9c0636c0 2022-05-02T09:41:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.985+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0a2f40 con 0x7feb9c0636c0 2022-05-02T09:41:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.986+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c06aa70 con 0x7feb9c0636c0 2022-05-02T09:41:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.987+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 7) v1 ==== 52684+0+0 (secure 0 0 0) 0x7feb98017020 con 0x7feb9c0636c0 2022-05-02T09:41:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.988+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7feb9805afb0 con 0x7feb9c0636c0 2022-05-02T09:41:52.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:52.995+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7feb9c06aa70 con 0x7feb9c0636c0 2022-05-02T09:41:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.050+0000 7f4e7f59e700 1 Processor -- start 2022-05-02T09:41:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.050+0000 7f4e7f59e700 1 -- start start 2022-05-02T09:41:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.051+0000 7f4e7f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e800636c0 0x7f4e80141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.051+0000 7f4e7f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e800a9bf0 0x7f4e80148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.051+0000 7f4e7f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80140ff0 con 0x7f4e801419c0 2022-05-02T09:41:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.051+0000 7f4e7f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e80063a90 con 0x7f4e800636c0 2022-05-02T09:41:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.051+0000 7f4e7f59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800a9200 con 0x7f4e800a9bf0 2022-05-02T09:41:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.052+0000 7f4e7e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e800636c0 0x7f4e80141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.052+0000 7f4e7dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e801419c0 0x7f4e8013e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52358/0 (socket says 172.21.15.50:52358) 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.052+0000 7f4e7dd9b700 1 -- 172.21.15.50:0/1299557578 learned_addr learned my addr 172.21.15.50:0/1299557578 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.052+0000 7f4e7ed9d700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e800a9bf0 0x7f4e80148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7e59c700 1 -- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e800a9bf0 msgr2=0x7f4e80148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7e59c700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e800a9bf0 0x7f4e80148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7e59c700 1 -- 172.21.15.50:0/1299557578 >> v1:172.21.15.50:6789/0 conn(0x7f4e801419c0 legacy=0x7f4e8013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7e59c700 1 -- 172.21.15.50:0/1299557578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80141e50 con 0x7f4e800636c0 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7e59c700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800636c0 0x7f4e80141480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009760 tx=0x7f4e70009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0704e8078a534d1 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7d59a700 1 -- 172.21.15.50:0/1299557578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011630 con 0x7f4e800636c0 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7d59a700 1 -- 172.21.15.50:0/1299557578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70011790 con 0x7f4e800636c0 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.053+0000 7f4e7d59a700 1 -- 172.21.15.50:0/1299557578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011b30 con 0x7f4e800636c0 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 -- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800636c0 msgr2=0x7f4e80141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800636c0 0x7f4e80141480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009760 tx=0x7f4e70009060 comp rx=0 tx=0).stop 2022-05-02T09:41:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 -- 172.21.15.50:0/1299557578 shutdown_connections 2022-05-02T09:41:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e800a9bf0 0x7f4e80148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/1299557578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800636c0 0x7f4e80141480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 -- 172.21.15.50:0/1299557578 >> 172.21.15.50:0/1299557578 conn(0x7f4e80069370 msgr2=0x7f4e80062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.054+0000 7f4e7f59e700 1 -- 172.21.15.50:0/1299557578 shutdown_connections 2022-05-02T09:41:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.055+0000 7f4e7f59e700 1 -- 172.21.15.50:0/1299557578 wait complete. 2022-05-02T09:41:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.056+0000 7f4e7f59e700 1 Processor -- start 2022-05-02T09:41:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.056+0000 7f4e7f59e700 1 -- start start 2022-05-02T09:41:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 0x7f4e800b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800a9bf0 0x7f4e800af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 0x7f4e8014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b02e0 con 0x7f4e800a9bf0 2022-05-02T09:41:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8014db80 con 0x7f4e800636c0 2022-05-02T09:41:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7f59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800add00 con 0x7f4e801419c0 2022-05-02T09:41:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 0x7f4e800b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800a9bf0 0x7f4e800af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 0x7f4e8014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 0x7f4e800b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50614/0 (socket says 172.21.15.50:50614) 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.058+0000 7f4e7e59c700 1 -- 172.21.15.50:0/2342492154 learned_addr learned my addr 172.21.15.50:0/2342492154 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.059+0000 7f4e7ed9d700 1 -- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 msgr2=0x7f4e800b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.059+0000 7f4e7ed9d700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 0x7f4e800b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.059+0000 7f4e7ed9d700 1 -- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800a9bf0 msgr2=0x7f4e800af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.059+0000 7f4e7ed9d700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800a9bf0 0x7f4e800af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.059+0000 7f4e7ed9d700 1 -- 172.21.15.50:0/2342492154 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e700092a0 con 0x7f4e801419c0 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e7ed9d700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 0x7f4e8014de40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4e78007ea0 tx=0x7f4e78009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78018070 con 0x7f4e801419c0 2022-05-02T09:41:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800eac0 con 0x7f4e801419c0 2022-05-02T09:41:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e800b1000 con 0x7f4e801419c0 2022-05-02T09:41:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800ee60 con 0x7f4e801419c0 2022-05-02T09:41:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.060+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800ae380 con 0x7f4e801419c0 2022-05-02T09:41:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.061+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e800ae5a0 con 0x7f4e801419c0 2022-05-02T09:41:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.062+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 7) v1 ==== 52684+0+0 (secure 0 0 0) 0x7f4e78012050 con 0x7f4e801419c0 2022-05-02T09:41:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.063+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f4e78059610 con 0x7f4e801419c0 2022-05-02T09:41:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.072+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f4e800ae5a0 con 0x7f4e801419c0 2022-05-02T09:41:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.127+0000 7fd11b59e700 1 Processor -- start 2022-05-02T09:41:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.127+0000 7fd11b59e700 1 -- start start 2022-05-02T09:41:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.128+0000 7fd11b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd11c0636c0 0x7fd11c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.128+0000 7fd11b59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 0x7fd11c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.128+0000 7fd11b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c140ff0 con 0x7fd11c1419c0 2022-05-02T09:41:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd11b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11c063a90 con 0x7fd11c0636c0 2022-05-02T09:41:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd11b59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0a9200 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd11a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd11c0636c0 0x7fd11c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd119d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd11c1419c0 0x7fd11c13e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52360/0 (socket says 172.21.15.50:52360) 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd119d9b700 1 -- 172.21.15.50:0/1756595793 learned_addr learned my addr 172.21.15.50:0/1756595793 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.129+0000 7fd11ad9d700 1 --2- 172.21.15.50:0/1756595793 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 0x7fd11c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.130+0000 7fd11ad9d700 1 -- 172.21.15.50:0/1756595793 >> v2:172.21.15.50:3300/0 conn(0x7fd11c0636c0 msgr2=0x7fd11c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.130+0000 7fd11ad9d700 1 --2- 172.21.15.50:0/1756595793 >> v2:172.21.15.50:3300/0 conn(0x7fd11c0636c0 0x7fd11c141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.130+0000 7fd11ad9d700 1 -- 172.21.15.50:0/1756595793 >> v1:172.21.15.50:6789/0 conn(0x7fd11c1419c0 legacy=0x7fd11c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.130+0000 7fd11ad9d700 1 -- 172.21.15.50:0/1756595793 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c141e50 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.130+0000 7fd11ad9d700 1 --2- 172.21.15.50:0/1756595793 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 0x7fd11c148330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd114009e60 tx=0x7fd114009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8eb844a18c979f9 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.131+0000 7fd11959a700 1 -- 172.21.15.50:0/1756595793 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400e070 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.131+0000 7fd11959a700 1 -- 172.21.15.50:0/1756595793 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400bbf0 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.131+0000 7fd11959a700 1 -- 172.21.15.50:0/1756595793 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114012430 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 -- 172.21.15.50:0/1756595793 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 msgr2=0x7fd11c148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1756595793 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 0x7fd11c148330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd114009e60 tx=0x7fd114009780 comp rx=0 tx=0).stop 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 -- 172.21.15.50:0/1756595793 shutdown_connections 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1756595793 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0a9bf0 0x7fd11c148330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1756595793 >> v2:172.21.15.50:3300/0 conn(0x7fd11c0636c0 0x7fd11c141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 -- 172.21.15.50:0/1756595793 >> 172.21.15.50:0/1756595793 conn(0x7fd11c069370 msgr2=0x7fd11c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 -- 172.21.15.50:0/1756595793 shutdown_connections 2022-05-02T09:41:53.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.132+0000 7fd11b59e700 1 -- 172.21.15.50:0/1756595793 wait complete. 2022-05-02T09:41:53.136 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.134+0000 7fd11b59e700 1 Processor -- start 2022-05-02T09:41:53.137 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.135+0000 7fd11b59e700 1 -- start start 2022-05-02T09:41:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0636c0 0x7fd11c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c1419c0 0x7fd11c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0ae960 con 0x7fd11c1419c0 2022-05-02T09:41:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0b0a00 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd11b59e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0ad0b0 con 0x7fd11c0636c0 2022-05-02T09:41:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd119d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd119d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50616/0 (socket says 172.21.15.50:50616) 2022-05-02T09:41:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.136+0000 7fd119d9b700 1 -- 172.21.15.50:0/1197716879 learned_addr learned my addr 172.21.15.50:0/1197716879 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd11a59c700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0636c0 0x7fd11c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd11ad9d700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c1419c0 0x7fd11c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd119d9b700 1 -- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0636c0 msgr2=0x7fd11c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd119d9b700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0636c0 0x7fd11c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd119d9b700 1 -- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c1419c0 msgr2=0x7fd11c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd119d9b700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c1419c0 0x7fd11c1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.137+0000 7fd119d9b700 1 -- 172.21.15.50:0/1197716879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009a20 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.138+0000 7fd119d9b700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd110001eb0 tx=0x7fd110007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.138+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100070d0 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.138+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd110007230 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.138+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100075b0 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.138+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c151b20 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.139+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c0adf40 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.140+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c151430 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.141+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 7) v1 ==== 52684+0+0 (secure 0 0 0) 0x7fd110019030 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.142+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fd1100587a0 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.146+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fd110037600 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.163+0000 7f668219d700 1 Processor -- start 2022-05-02T09:41:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.163+0000 7f668219d700 1 -- start start 2022-05-02T09:41:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.164+0000 7f668219d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.164+0000 7f668219d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f667c1419c0 0x7f667c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.164+0000 7f668219d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c140ff0 con 0x7f667c0a9bf0 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.164+0000 7f668219d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c063a90 con 0x7f667c1419c0 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.164+0000 7f668219d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0a9200 con 0x7f667c0636c0 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.165+0000 7f668119b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.165+0000 7f668119b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49950/0 (socket says 172.21.15.50:49950) 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.165+0000 7f668119b700 1 -- 172.21.15.50:0/2783424920 learned_addr learned my addr 172.21.15.50:0/2783424920 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.165+0000 7f668099a700 1 --2- 172.21.15.50:0/2783424920 >> v2:172.21.15.50:3300/0 conn(0x7f667c1419c0 0x7f667c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.165+0000 7f668119b700 1 -- 172.21.15.50:0/2783424920 >> v2:172.21.15.50:3300/0 conn(0x7f667c1419c0 msgr2=0x7f667c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.166+0000 7f668119b700 1 --2- 172.21.15.50:0/2783424920 >> v2:172.21.15.50:3300/0 conn(0x7f667c1419c0 0x7f667c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.166+0000 7f668119b700 1 -- 172.21.15.50:0/2783424920 >> v1:172.21.15.50:6789/0 conn(0x7f667c0a9bf0 legacy=0x7f667c0a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.166+0000 7f668119b700 1 -- 172.21.15.50:0/2783424920 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c141e50 con 0x7f667c0636c0 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.166+0000 7f668119b700 1 --2- 172.21.15.50:0/2783424920 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f66780090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2010ae9bce64d8b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f666bfff700 1 -- 172.21.15.50:0/2783424920 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678004030 con 0x7f667c0636c0 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f666bfff700 1 -- 172.21.15.50:0/2783424920 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780041d0 con 0x7f667c0636c0 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f666bfff700 1 -- 172.21.15.50:0/2783424920 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011630 con 0x7f667c0636c0 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 -- 172.21.15.50:0/2783424920 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 msgr2=0x7f667c141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 --2- 172.21.15.50:0/2783424920 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f66780090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 -- 172.21.15.50:0/2783424920 shutdown_connections 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 --2- 172.21.15.50:0/2783424920 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c0636c0 0x7f667c141480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 --2- 172.21.15.50:0/2783424920 >> v2:172.21.15.50:3300/0 conn(0x7f667c1419c0 0x7f667c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.167+0000 7f668219d700 1 -- 172.21.15.50:0/2783424920 >> 172.21.15.50:0/2783424920 conn(0x7f667c069370 msgr2=0x7f667c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.168+0000 7f668219d700 1 -- 172.21.15.50:0/2783424920 shutdown_connections 2022-05-02T09:41:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.168+0000 7f668219d700 1 -- 172.21.15.50:0/2783424920 wait complete. 2022-05-02T09:41:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.169+0000 7f668219d700 1 Processor -- start 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.169+0000 7f668219d700 1 -- start start 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 0x7f667c0aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c1419c0 0x7f667c140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0abe90 con 0x7f667c0636c0 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0ac130 con 0x7f667c0a9bf0 2022-05-02T09:41:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.170+0000 7f668219d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0a2fc0 con 0x7f667c1419c0 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.171+0000 7f668119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.171+0000 7f668119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36076/0 (socket says 172.21.15.50:36076) 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.171+0000 7f668119b700 1 -- 172.21.15.50:0/2562049633 learned_addr learned my addr 172.21.15.50:0/2562049633 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.171+0000 7f668199c700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c1419c0 0x7f667c140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.171+0000 7f668099a700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 0x7f667c0aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 -- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c1419c0 msgr2=0x7f667c140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c1419c0 0x7f667c140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 -- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 msgr2=0x7f667c0aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 0x7f667c0aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 -- 172.21.15.50:0/2562049633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009370 con 0x7f667c0636c0 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668099a700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 0x7f667c0aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.172+0000 7f668119b700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6678004000 tx=0x7f6678016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.173+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780036f0 con 0x7f667c0636c0 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.173+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c140d90 con 0x7f667c0636c0 2022-05-02T09:41:53.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.173+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678003870 con 0x7f667c0636c0 2022-05-02T09:41:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.173+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678003c70 con 0x7f667c0636c0 2022-05-02T09:41:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.173+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0abc20 con 0x7f667c0636c0 2022-05-02T09:41:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.174+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c13c9d0 con 0x7f667c0636c0 2022-05-02T09:41:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.175+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 7) v1 ==== 52684+0+0 (secure 0 0 0) 0x7f667802b030 con 0x7f667c0636c0 2022-05-02T09:41:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.176+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f667805b120 con 0x7f667c0636c0 2022-05-02T09:41:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.180+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f667c13c9d0 con 0x7f667c0636c0 2022-05-02T09:41:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.182+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb9c06aa70 con 0x7feb9c0636c0 2022-05-02T09:41:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.183+0000 7feb897fa700 1 -- 172.21.15.50:0/1631999992 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb9c06aa70 con 0x7feb9c0636c0 2022-05-02T09:41:53.185 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 >> v1:172.21.15.50:6800/36423 conn(0x7feb7c0449d0 legacy=0x7feb7c046e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 msgr2=0x7feb9c06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb9c063bd0 tx=0x7feb98016000 comp rx=0 tx=0).stop 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 shutdown_connections 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feb9c1419c0 0x7feb9c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb9c0636c0 0x7feb9c06c020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 --2- 172.21.15.50:0/1631999992 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7feb9c0a9bf0 0x7feb9c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 >> 172.21.15.50:0/1631999992 conn(0x7feb9c069370 msgr2=0x7feb9c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 shutdown_connections 2022-05-02T09:41:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.185+0000 7feba279d700 1 -- 172.21.15.50:0/1631999992 wait complete. 2022-05-02T09:41:53.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.2 2022-05-02T09:41:53.275 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.272+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e800ae5a0 con 0x7f4e801419c0 2022-05-02T09:41:53.277 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.273+0000 7f4e6e7fc700 1 -- 172.21.15.50:0/2342492154 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e800ae5a0 con 0x7f4e801419c0 2022-05-02T09:41:53.277 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 >> v1:172.21.15.50:6800/36423 conn(0x7f4e5c044a00 legacy=0x7f4e5c046eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 msgr2=0x7f4e8014de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 0x7f4e8014de40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4e78007ea0 tx=0x7f4e78009850 comp rx=0 tx=0).stop 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 shutdown_connections 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f4e801419c0 0x7f4e8014de40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800636c0 0x7f4e800b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 --2- 172.21.15.50:0/2342492154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e800a9bf0 0x7f4e800af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 >> 172.21.15.50:0/2342492154 conn(0x7f4e80069370 msgr2=0x7f4e8013aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.281 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 shutdown_connections 2022-05-02T09:41:53.281 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.275+0000 7f4e7f59e700 1 -- 172.21.15.50:0/2342492154 wait complete. 2022-05-02T09:41:53.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.1 2022-05-02T09:41:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.319+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd11c140e30 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.320+0000 7fd10a7fc700 1 -- 172.21.15.50:0/1197716879 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd110017020 con 0x7fd11c0a9bf0 2022-05-02T09:41:53.322 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:53.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 >> v1:172.21.15.50:6800/36423 conn(0x7fd0f80449d0 legacy=0x7fd0f8046e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.324 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 msgr2=0x7fd11c0b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd110001eb0 tx=0x7fd110007df0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 shutdown_connections 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd11c0636c0 0x7fd11c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd11c1419c0 0x7fd11c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 --2- 172.21.15.50:0/1197716879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd11c0a9bf0 0x7fd11c0b04c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 >> 172.21.15.50:0/1197716879 conn(0x7fd11c069370 msgr2=0x7fd11c139e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 shutdown_connections 2022-05-02T09:41:53.325 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.322+0000 7fd11b59e700 1 -- 172.21.15.50:0/1197716879 wait complete. 2022-05-02T09:41:53.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.0 2022-05-02T09:41:53.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.368+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f667c13c9d0 con 0x7f667c0636c0 2022-05-02T09:41:53.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.369+0000 7f66697fa700 1 -- 172.21.15.50:0/2562049633 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f667c13c9d0 con 0x7f667c0636c0 2022-05-02T09:41:53.372 INFO:teuthology.orchestra.run.smithi050.stdout:42949672994 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 >> v1:172.21.15.50:6800/36423 conn(0x7f665c0449d0 legacy=0x7f665c046e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 msgr2=0x7f667c13cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6678004000 tx=0x7f6678016000 comp rx=0 tx=0).stop 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 shutdown_connections 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f667c1419c0 0x7f667c140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667c0636c0 0x7f667c13cc90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 --2- 172.21.15.50:0/2562049633 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f667c0a9bf0 0x7f667c0aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:53.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 >> 172.21.15.50:0/2562049633 conn(0x7f667c069370 msgr2=0x7f667c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:53.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 shutdown_connections 2022-05-02T09:41:53.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:53.371+0000 7f668219d700 1 -- 172.21.15.50:0/2562049633 wait complete. 2022-05-02T09:41:53.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2022-05-02T09:41:54.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:41:54.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:41:54.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:41:54.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:41:54.465 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.463+0000 7f707999d700 1 Processor -- start 2022-05-02T09:41:54.466 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.463+0000 7f707999d700 1 -- start start 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.464+0000 7f707999d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f7074141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f707999d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f707999d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70740a9bf0 0x7f707413e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f707999d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7074140ff0 con 0x7f70740a9bf0 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f707999d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7074063a90 con 0x7f70741419c0 2022-05-02T09:41:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f707999d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70740a9200 con 0x7f70740636c0 2022-05-02T09:41:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f7073fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f7073fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50626/0 (socket says 172.21.15.50:50626) 2022-05-02T09:41:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.465+0000 7f7073fff700 1 -- 172.21.15.50:0/3002503428 learned_addr learned my addr 172.21.15.50:0/3002503428 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f707899b700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f7074141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f707919c700 1 --2- 172.21.15.50:0/3002503428 >> v2:172.21.15.50:3300/0 conn(0x7f70740a9bf0 0x7f707413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f7073fff700 1 -- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 msgr2=0x7f7074141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f7073fff700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f7074141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f7073fff700 1 -- 172.21.15.50:0/3002503428 >> v2:172.21.15.50:3300/0 conn(0x7f70740a9bf0 msgr2=0x7f707413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f7073fff700 1 --2- 172.21.15.50:0/3002503428 >> v2:172.21.15.50:3300/0 conn(0x7f70740a9bf0 0x7f707413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.466+0000 7f7073fff700 1 -- 172.21.15.50:0/3002503428 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074141e50 con 0x7f70741419c0 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.467+0000 7f7073fff700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7060009830 tx=0x7f70600090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ebfdc78d15c28a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.467+0000 7f70737fe700 1 -- 172.21.15.50:0/3002503428 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060004030 con 0x7f70741419c0 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.467+0000 7f70737fe700 1 -- 172.21.15.50:0/3002503428 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060004190 con 0x7f70741419c0 2022-05-02T09:41:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.467+0000 7f70737fe700 1 -- 172.21.15.50:0/3002503428 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706000b690 con 0x7f70741419c0 2022-05-02T09:41:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 -- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 msgr2=0x7f707413e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7060009830 tx=0x7f70600090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 -- 172.21.15.50:0/3002503428 shutdown_connections 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 --2- 172.21.15.50:0/3002503428 >> v2:172.21.15.50:3300/0 conn(0x7f70740a9bf0 0x7f707413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f7074141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 --2- 172.21.15.50:0/3002503428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f707413e000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 -- 172.21.15.50:0/3002503428 >> 172.21.15.50:0/3002503428 conn(0x7f7074069370 msgr2=0x7f7074062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 -- 172.21.15.50:0/3002503428 shutdown_connections 2022-05-02T09:41:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.468+0000 7f707999d700 1 -- 172.21.15.50:0/3002503428 wait complete. 2022-05-02T09:41:54.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.470+0000 7f707999d700 1 Processor -- start 2022-05-02T09:41:54.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 -- start start 2022-05-02T09:41:54.474 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f70740b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.474 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70740a9bf0 0x7f70740ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.474 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f70740acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.475 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741511d0 con 0x7f70740a9bf0 2022-05-02T09:41:54.475 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740adfd0 con 0x7f70741419c0 2022-05-02T09:41:54.475 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.471+0000 7f707999d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70740ad990 con 0x7f70740636c0 2022-05-02T09:41:54.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.472+0000 7f707919c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f70740acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.472+0000 7f707919c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f70740acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50628/0 (socket says 172.21.15.50:50628) 2022-05-02T09:41:54.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.472+0000 7f707919c700 1 -- 172.21.15.50:0/130543753 learned_addr learned my addr 172.21.15.50:0/130543753 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.472+0000 7f7073fff700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70740a9bf0 0x7f70740ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.472+0000 7f707899b700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f70740b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.473+0000 7f707899b700 1 -- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 msgr2=0x7f70740acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.473+0000 7f707899b700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f70740acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.473+0000 7f707899b700 1 -- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70740a9bf0 msgr2=0x7f70740ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.473+0000 7f707899b700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70740a9bf0 0x7f70740ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.473+0000 7f707899b700 1 -- 172.21.15.50:0/130543753 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009370 con 0x7f70740636c0 2022-05-02T09:41:54.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.474+0000 7f707899b700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f70740b45f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f706800d890 tx=0x7f7068008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.474+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70680125f0 con 0x7f70740636c0 2022-05-02T09:41:54.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.474+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068012750 con 0x7f70740636c0 2022-05-02T09:41:54.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.474+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70740ab450 con 0x7f70740636c0 2022-05-02T09:41:54.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.474+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068012b10 con 0x7f70740636c0 2022-05-02T09:41:54.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.475+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70740ad6c0 con 0x7f70740636c0 2022-05-02T09:41:54.483 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.477+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70740a6ca0 con 0x7f70740636c0 2022-05-02T09:41:54.483 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.477+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 8) v1 ==== 52844+0+0 (secure 0 0 0) 0x7f706801e460 con 0x7f70740636c0 2022-05-02T09:41:54.483 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.478+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7068059d00 con 0x7f70740636c0 2022-05-02T09:41:54.487 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.485+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f7068038c50 con 0x7f70740636c0 2022-05-02T09:41:54.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.568+0000 7fbd1639d700 1 Processor -- start 2022-05-02T09:41:54.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.569+0000 7fbd1639d700 1 -- start start 2022-05-02T09:41:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1639d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd100a9a80 0x7fbd1013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1639d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd1013b000 0x7fbd101481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1639d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b4350 con 0x7fbd100b3f80 2022-05-02T09:41:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1639d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100a4440 con 0x7fbd100a9a80 2022-05-02T09:41:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1639d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1013d8a0 con 0x7fbd1013b000 2022-05-02T09:41:54.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd14b9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd100a9a80 0x7fbd1013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1539b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbd100b3f80 0x7fbd1013dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52364/0 (socket says 172.21.15.50:52364) 2022-05-02T09:41:54.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.570+0000 7fbd1539b700 1 -- 172.21.15.50:0/372611837 learned_addr learned my addr 172.21.15.50:0/372611837 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:54.573 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbd15b9c700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd1013b000 0x7fbd101481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbd14b9a700 1 -- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd1013b000 msgr2=0x7fbd101481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbd14b9a700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd1013b000 0x7fbd101481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbd14b9a700 1 -- 172.21.15.50:0/372611837 >> v1:172.21.15.50:6789/0 conn(0x7fbd100b3f80 legacy=0x7fbd1013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbcfffff700 1 -- 172.21.15.50:0/372611837 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171940996 0 0) 0x7fbd100b4350 con 0x7fbd100b3f80 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.571+0000 7fbd14b9a700 1 -- 172.21.15.50:0/372611837 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1013e710 con 0x7fbd100a9a80 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.572+0000 7fbd14b9a700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd100a9a80 0x7fbd1013aac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009760 tx=0x7fbd00009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa11a4e230929c1 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.572+0000 7fbcfffff700 1 -- 172.21.15.50:0/372611837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011630 con 0x7fbd100a9a80 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.572+0000 7fbcfffff700 1 -- 172.21.15.50:0/372611837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00011790 con 0x7fbd100a9a80 2022-05-02T09:41:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.572+0000 7fbcfffff700 1 -- 172.21.15.50:0/372611837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011b30 con 0x7fbd100a9a80 2022-05-02T09:41:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.573+0000 7fbd1639d700 1 -- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd100a9a80 msgr2=0x7fbd1013aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.573+0000 7fbd1639d700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd100a9a80 0x7fbd1013aac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009760 tx=0x7fbd00009060 comp rx=0 tx=0).stop 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.573+0000 7fbd1639d700 1 -- 172.21.15.50:0/372611837 shutdown_connections 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.573+0000 7fbd1639d700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd1013b000 0x7fbd101481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.573+0000 7fbd1639d700 1 --2- 172.21.15.50:0/372611837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd100a9a80 0x7fbd1013aac0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009760 tx=0x7fbd00009060 comp rx=0 tx=0).stop 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.574+0000 7fbd1639d700 1 -- 172.21.15.50:0/372611837 >> 172.21.15.50:0/372611837 conn(0x7fbd10069580 msgr2=0x7fbd100674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.574+0000 7fbd1639d700 1 -- 172.21.15.50:0/372611837 shutdown_connections 2022-05-02T09:41:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.574+0000 7fbd1639d700 1 -- 172.21.15.50:0/372611837 wait complete. 2022-05-02T09:41:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.576+0000 7fbd1639d700 1 Processor -- start 2022-05-02T09:41:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.577+0000 7fbd1639d700 1 -- start start 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd100b3f80 0x7fbd100a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 0x7fbd1014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a18d0 con 0x7fbd1013b000 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10152040 con 0x7fbd100b3f80 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.578+0000 7fbd1639d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10152300 con 0x7fbd10152910 2022-05-02T09:41:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.579+0000 7fbd14b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.579+0000 7fbd14b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36088/0 (socket says 172.21.15.50:36088) 2022-05-02T09:41:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.579+0000 7fbd14b9a700 1 -- 172.21.15.50:0/2946436897 learned_addr learned my addr 172.21.15.50:0/2946436897 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.579+0000 7fbd1539b700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd100b3f80 0x7fbd100a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.579+0000 7fbd15b9c700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 0x7fbd1014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.580+0000 7fbd14b9a700 1 -- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 msgr2=0x7fbd1014f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.580+0000 7fbd14b9a700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 0x7fbd1014f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.580+0000 7fbd14b9a700 1 -- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd100b3f80 msgr2=0x7fbd100a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.580+0000 7fbd14b9a700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd100b3f80 0x7fbd100a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.580+0000 7fbd14b9a700 1 -- 172.21.15.50:0/2946436897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000092a0 con 0x7fbd1013b000 2022-05-02T09:41:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.581+0000 7fbd14b9a700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006f4c0 tx=0x7fbd00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.582+0000 7fbd15b9c700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 0x7fbd1014f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:41:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.583+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00003770 con 0x7fbd1013b000 2022-05-02T09:41:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.583+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000038d0 con 0x7fbd1013b000 2022-05-02T09:41:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.583+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00003c70 con 0x7fbd1013b000 2022-05-02T09:41:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.584+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd100a27d0 con 0x7fbd1013b000 2022-05-02T09:41:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.584+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1009ff40 con 0x7fbd1013b000 2022-05-02T09:41:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.585+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd100a0160 con 0x7fbd1013b000 2022-05-02T09:41:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.587+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 52844+0+0 (secure 0 0 0) 0x7fbd0000f050 con 0x7fbd1013b000 2022-05-02T09:41:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.588+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fbd0005ab30 con 0x7fbd1013b000 2022-05-02T09:41:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.597+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fbd000243b0 con 0x7fbd1013b000 2022-05-02T09:41:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.641+0000 7faadc7ff700 1 Processor -- start 2022-05-02T09:41:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.641+0000 7faadc7ff700 1 -- start start 2022-05-02T09:41:54.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.642+0000 7faadc7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.642+0000 7faadc7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad413e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.642+0000 7faadc7ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad40a0780 con 0x7faad413e270 2022-05-02T09:41:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.642+0000 7faadc7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad413dcd0 con 0x7faad406d7d0 2022-05-02T09:41:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.642+0000 7faadc7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad406cab0 con 0x7faad40a03b0 2022-05-02T09:41:54.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49966/0 (socket says 172.21.15.50:49966) 2022-05-02T09:41:54.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 -- 172.21.15.50:0/1254735700 learned_addr learned my addr 172.21.15.50:0/1254735700 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faad9d9a700 1 --1- 172.21.15.50:0/1254735700 >> v1:172.21.15.50:6789/0 conn(0x7faad413e270 0x7faad406d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52366/0 (socket says 172.21.15.50:52366) 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faadad9c700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 -- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 msgr2=0x7faad413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 -- 172.21.15.50:0/1254735700 >> v1:172.21.15.50:6789/0 conn(0x7faad413e270 legacy=0x7faad406d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.643+0000 7faada59b700 1 -- 172.21.15.50:0/1254735700 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad406ec80 con 0x7faad40a03b0 2022-05-02T09:41:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.644+0000 7faada59b700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faad000b910 tx=0x7faad00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f551618b8e7a06e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.644+0000 7faad9599700 1 -- 172.21.15.50:0/1254735700 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000c950 con 0x7faad40a03b0 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.644+0000 7faad9599700 1 -- 172.21.15.50:0/1254735700 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad000cab0 con 0x7faad40a03b0 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.644+0000 7faad9599700 1 -- 172.21.15.50:0/1254735700 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000ce70 con 0x7faad40a03b0 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 -- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 msgr2=0x7faad406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faad000b910 tx=0x7faad00090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 -- 172.21.15.50:0/1254735700 shutdown_connections 2022-05-02T09:41:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 --2- 172.21.15.50:0/1254735700 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad40a03b0 0x7faad406e740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 -- 172.21.15.50:0/1254735700 >> 172.21.15.50:0/1254735700 conn(0x7faad4062df0 msgr2=0x7faad40631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.645+0000 7faadc7ff700 1 -- 172.21.15.50:0/1254735700 shutdown_connections 2022-05-02T09:41:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.646+0000 7faadc7ff700 1 -- 172.21.15.50:0/1254735700 wait complete. 2022-05-02T09:41:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.647+0000 7faadc7ff700 1 Processor -- start 2022-05-02T09:41:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.647+0000 7faadc7ff700 1 -- start start 2022-05-02T09:41:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad40afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40a03b0 0x7faad409a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad414cc50 con 0x7faad40a03b0 2022-05-02T09:41:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad4096ab0 con 0x7faad406d7d0 2022-05-02T09:41:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.648+0000 7faadc7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b0690 con 0x7faad413e270 2022-05-02T09:41:54.653 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49968/0 (socket says 172.21.15.50:49968) 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 -- 172.21.15.50:0/2913920375 learned_addr learned my addr 172.21.15.50:0/2913920375 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faada59b700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad40afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faad9d9a700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40a03b0 0x7faad409a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 -- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 msgr2=0x7faad40afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.654 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad40afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 -- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40a03b0 msgr2=0x7faad409a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40a03b0 0x7faad409a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.649+0000 7faadad9c700 1 -- 172.21.15.50:0/2913920375 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad000b420 con 0x7faad413e270 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.650+0000 7faadad9c700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faacc0115d0 tx=0x7faacc00b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.650+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00f040 con 0x7faad413e270 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.650+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011e80 con 0x7faad413e270 2022-05-02T09:41:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.650+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01f660 con 0x7faad413e270 2022-05-02T09:41:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.650+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad414dab0 con 0x7faad413e270 2022-05-02T09:41:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.651+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad414d620 con 0x7faad413e270 2022-05-02T09:41:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.652+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 8) v1 ==== 52844+0+0 (secure 0 0 0) 0x7faacc01fa10 con 0x7faad413e270 2022-05-02T09:41:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.653+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad414cdc0 con 0x7faad413e270 2022-05-02T09:41:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.653+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7faacc01a030 con 0x7faad413e270 2022-05-02T09:41:54.660 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.657+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7faacc03d6a0 con 0x7faad413e270 2022-05-02T09:41:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.713+0000 7f51081ff700 1 Processor -- start 2022-05-02T09:41:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.714+0000 7f51081ff700 1 -- start start 2022-05-02T09:41:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51000636c0 0x7f51000a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 0x7f510013ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 0x7f51000a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000a3900 con 0x7f51000636c0 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100063a90 con 0x7f51000a1e80 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.715+0000 7f51081ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51000a2920 con 0x7f510013b360 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f5105f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51000636c0 0x7f51000a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f510579a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 0x7f510013ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f5105f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51000636c0 0x7f51000a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36092/0 (socket says 172.21.15.50:36092) 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f5105f9b700 1 -- 172.21.15.50:0/377750499 learned_addr learned my addr 172.21.15.50:0/377750499 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f510679c700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 0x7f51000a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.716+0000 7f510579a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 0x7f510013ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50636/0 (socket says 172.21.15.50:50636) 2022-05-02T09:41:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 -- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 msgr2=0x7f51000a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 0x7f51000a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 -- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 msgr2=0x7f510013ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 0x7f510013ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 -- 172.21.15.50:0/377750499 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000a0fc0 con 0x7f51000636c0 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f510679c700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 0x7f51000a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.717+0000 7f5105f9b700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000636c0 0x7f51000a33c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513d96b67fee4e2f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.718+0000 7f5104f99700 1 -- 172.21.15.50:0/377750499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004030 con 0x7f51000636c0 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.718+0000 7f5104f99700 1 -- 172.21.15.50:0/377750499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0041b0 con 0x7f51000636c0 2022-05-02T09:41:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.718+0000 7f5104f99700 1 -- 172.21.15.50:0/377750499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011630 con 0x7f51000636c0 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.718+0000 7f51081ff700 1 -- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000636c0 msgr2=0x7f51000a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.718+0000 7f51081ff700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000636c0 0x7f51000a33c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc0090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 -- 172.21.15.50:0/377750499 shutdown_connections 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f510013b360 0x7f51000a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000636c0 0x7f51000a33c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 --2- 172.21.15.50:0/377750499 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f51000a1e80 0x7f510013ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 -- 172.21.15.50:0/377750499 >> 172.21.15.50:0/377750499 conn(0x7f5100067eb0 msgr2=0x7f5100062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 -- 172.21.15.50:0/377750499 shutdown_connections 2022-05-02T09:41:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.719+0000 7f51081ff700 1 -- 172.21.15.50:0/377750499 wait complete. 2022-05-02T09:41:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.721+0000 7f51081ff700 1 Processor -- start 2022-05-02T09:41:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.721+0000 7f51081ff700 1 -- start start 2022-05-02T09:41:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000a1e80 0x7f510006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f510013b360 0x7f5100155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:54.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510006a5c0 con 0x7f51000a1e80 2022-05-02T09:41:54.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510006bd40 con 0x7f510013b360 2022-05-02T09:41:54.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.722+0000 7f51081ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510006beb0 con 0x7f51000636c0 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.723+0000 7f5105f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.723+0000 7f5105f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49972/0 (socket says 172.21.15.50:49972) 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.723+0000 7f5105f9b700 1 -- 172.21.15.50:0/4139822488 learned_addr learned my addr 172.21.15.50:0/4139822488 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.723+0000 7f510679c700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f510013b360 0x7f5100155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.723+0000 7f510579a700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000a1e80 0x7f510006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 -- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f510013b360 msgr2=0x7f5100155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f510013b360 0x7f5100155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 -- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000a1e80 msgr2=0x7f510006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000a1e80 0x7f510006ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 -- 172.21.15.50:0/4139822488 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009370 con 0x7f51000636c0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.724+0000 7f5105f9b700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004000 tx=0x7f50fc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.725+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011630 con 0x7f51000636c0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.725+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0036f0 con 0x7f51000636c0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.725+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc003ab0 con 0x7f51000636c0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.725+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510006d1f0 con 0x7f51000636c0 2022-05-02T09:41:54.729 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.725+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510006e530 con 0x7f51000636c0 2022-05-02T09:41:54.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.727+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 8) v1 ==== 52844+0+0 (secure 0 0 0) 0x7f50fc02b030 con 0x7f51000636c0 2022-05-02T09:41:54.730 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.727+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510006d410 con 0x7f51000636c0 2022-05-02T09:41:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.728+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f50fc05adc0 con 0x7f51000636c0 2022-05-02T09:41:54.737 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.735+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f50fc026760 con 0x7f51000636c0 2022-05-02T09:41:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.767+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70740a3b80 con 0x7f70740636c0 2022-05-02T09:41:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.768+0000 7f7070ff9700 1 -- 172.21.15.50:0/130543753 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f706803c270 con 0x7f70740636c0 2022-05-02T09:41:54.771 INFO:teuthology.orchestra.run.smithi050.stdout:42949672996 2022-05-02T09:41:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 >> v1:172.21.15.50:6800/36423 conn(0x7f705c044bc0 legacy=0x7f705c047070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 msgr2=0x7f70740b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f70740b45f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f706800d890 tx=0x7f7068008040 comp rx=0 tx=0).stop 2022-05-02T09:41:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 shutdown_connections 2022-05-02T09:41:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f70740636c0 0x7f70740b45f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70741419c0 0x7f70740acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 --2- 172.21.15.50:0/130543753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70740a9bf0 0x7f70740ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.770+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 >> 172.21.15.50:0/130543753 conn(0x7f7074069370 msgr2=0x7f707413ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.771+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 shutdown_connections 2022-05-02T09:41:54.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.771+0000 7f707999d700 1 -- 172.21.15.50:0/130543753 wait complete. 2022-05-02T09:41:54.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672996 for osd.2 2022-05-02T09:41:54.810 DEBUG:teuthology.parallel:result is None 2022-05-02T09:41:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.870+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd10069980 con 0x7fbd1013b000 2022-05-02T09:41:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.885+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faad404bfb0 con 0x7faad413e270 2022-05-02T09:41:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.886+0000 7faac27fc700 1 -- 172.21.15.50:0/2913920375 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faacc040e90 con 0x7faad413e270 2022-05-02T09:41:54.889 INFO:teuthology.orchestra.run.smithi050.stdout:42949672996 2022-05-02T09:41:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 >> v1:172.21.15.50:6800/36423 conn(0x7faab4044af0 legacy=0x7faab4046fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 msgr2=0x7faad414d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faacc0115d0 tx=0x7faacc00b7c0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 shutdown_connections 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faad413e270 0x7faad414d0e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faad406d7d0 0x7faad40afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 --2- 172.21.15.50:0/2913920375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40a03b0 0x7faad409a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 >> 172.21.15.50:0/2913920375 conn(0x7faad4062df0 msgr2=0x7faad40631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 shutdown_connections 2022-05-02T09:41:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.888+0000 7faadc7ff700 1 -- 172.21.15.50:0/2913920375 wait complete. 2022-05-02T09:41:54.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672996 for osd.0 2022-05-02T09:41:54.916 DEBUG:teuthology.parallel:result is None 2022-05-02T09:41:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.954+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f510004bfb0 con 0x7f51000636c0 2022-05-02T09:41:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.954+0000 7f50edffb700 1 -- 172.21.15.50:0/4139822488 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50fc05c070 con 0x7f51000636c0 2022-05-02T09:41:54.957 INFO:teuthology.orchestra.run.smithi050.stdout:42949672996 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 >> v1:172.21.15.50:6800/36423 conn(0x7f50e0044af0 legacy=0x7f50e0046fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 msgr2=0x7f5100097470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004000 tx=0x7f50fc016000 comp rx=0 tx=0).stop 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 shutdown_connections 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f51000636c0 0x7f5100097470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f510013b360 0x7f5100155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 --2- 172.21.15.50:0/4139822488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51000a1e80 0x7f510006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 >> 172.21.15.50:0/4139822488 conn(0x7f5100067eb0 msgr2=0x7f510013f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 shutdown_connections 2022-05-02T09:41:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.956+0000 7f51081ff700 1 -- 172.21.15.50:0/4139822488 wait complete. 2022-05-02T09:41:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.958+0000 7fbcfd7fa700 1 -- 172.21.15.50:0/2946436897 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd00015020 con 0x7fbd1013b000 2022-05-02T09:41:54.961 INFO:teuthology.orchestra.run.smithi050.stdout:42949672996 2022-05-02T09:41:54.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 >> v1:172.21.15.50:6800/36423 conn(0x7fbcf0044c40 legacy=0x7fbcf00470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 msgr2=0x7fbd100a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:54.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006f4c0 tx=0x7fbd00017000 comp rx=0 tx=0).stop 2022-05-02T09:41:54.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 shutdown_connections 2022-05-02T09:41:54.966 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fbd10152910 0x7fbd1014f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.966 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd100b3f80 0x7fbd100a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.966 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 --2- 172.21.15.50:0/2946436897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd1013b000 0x7fbd100a2290 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:54.966 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 >> 172.21.15.50:0/2946436897 conn(0x7fbd10069580 msgr2=0x7fbd100a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:54.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 shutdown_connections 2022-05-02T09:41:54.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:54.961+0000 7fbd1639d700 1 -- 172.21.15.50:0/2946436897 wait complete. 2022-05-02T09:41:54.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672996 for osd.3 2022-05-02T09:41:54.987 DEBUG:teuthology.parallel:result is None 2022-05-02T09:41:54.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672996 for osd.1 2022-05-02T09:41:54.990 DEBUG:teuthology.parallel:result is None 2022-05-02T09:41:54.990 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-05-02T09:41:54.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:41:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.256+0000 7f9ccd1ff700 1 Processor -- start 2022-05-02T09:41:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.256+0000 7f9ccd1ff700 1 -- start start 2022-05-02T09:41:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9ccd1ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 0x7f9cc80a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9ccd1ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80b4c80 0x7f9cc813aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9ccd1ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc80a9970 con 0x7f9cc813b020 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9ccd1ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80a9b20 con 0x7f9cc80636c0 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9ccd1ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8063a90 con 0x7f9cc80b4c80 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9cc6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 0x7f9cc80a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9cc759e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9cc813b020 0x7f9cc8140ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52368/0 (socket says 172.21.15.50:52368) 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.257+0000 7f9cc759e700 1 -- 172.21.15.50:0/1973943058 learned_addr learned my addr 172.21.15.50:0/1973943058 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc659c700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80b4c80 0x7f9cc813aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc5d9b700 1 -- 172.21.15.50:0/1973943058 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535867425 0 0) 0x7f9cc80a9970 con 0x7f9cc813b020 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc5d9b700 1 -- 172.21.15.50:0/1973943058 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb40033f0 con 0x7f9cc813b020 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc6d9d700 1 -- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80b4c80 msgr2=0x7f9cc813aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc6d9d700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80b4c80 0x7f9cc813aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc6d9d700 1 -- 172.21.15.50:0/1973943058 >> v1:172.21.15.50:6789/0 conn(0x7f9cc813b020 legacy=0x7f9cc8140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.258+0000 7f9cc6d9d700 1 -- 172.21.15.50:0/1973943058 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80a9470 con 0x7f9cc80636c0 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.259+0000 7f9cc6d9d700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 0x7f9cc80a7ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80097c0 tx=0x7f9cb8009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40329419f0692451 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.259+0000 7f9cc5d9b700 1 -- 172.21.15.50:0/1973943058 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8011630 con 0x7f9cc80636c0 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.259+0000 7f9cc5d9b700 1 -- 172.21.15.50:0/1973943058 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8011790 con 0x7f9cc80636c0 2022-05-02T09:41:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.259+0000 7f9cc5d9b700 1 -- 172.21.15.50:0/1973943058 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8011b10 con 0x7f9cc80636c0 2022-05-02T09:41:55.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 msgr2=0x7f9cc80a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 0x7f9cc80a7ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80097c0 tx=0x7f9cb8009060 comp rx=0 tx=0).stop 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1973943058 shutdown_connections 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80636c0 0x7f9cc80a7ae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1973943058 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80b4c80 0x7f9cc813aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1973943058 >> 172.21.15.50:0/1973943058 conn(0x7f9cc8069590 msgr2=0x7f9cc8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1973943058 shutdown_connections 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.260+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1973943058 wait complete. 2022-05-02T09:41:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.262+0000 7f9ccd1ff700 1 Processor -- start 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.262+0000 7f9ccd1ff700 1 -- start start 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80636c0 0x7f9cc80add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc813ce80 con 0x7f9cc813b020 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80ad520 con 0x7f9cc80b4c80 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9ccd1ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80ad800 con 0x7f9cc80636c0 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc6d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80636c0 0x7f9cc80add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36098/0 (socket says 172.21.15.50:36098) 2022-05-02T09:41:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc759e700 1 -- 172.21.15.50:0/1768514025 learned_addr learned my addr 172.21.15.50:0/1768514025 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.263+0000 7f9cc659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50644/0 (socket says 172.21.15.50:50644) 2022-05-02T09:41:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 -- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80636c0 msgr2=0x7f9cc80add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80636c0 0x7f9cc80add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 -- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 msgr2=0x7f9cc80acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 -- 172.21.15.50:0/1768514025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80092a0 con 0x7f9cc813b020 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc659c700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9cc759e700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005ad0 tx=0x7f9cc00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0005d30 con 0x7f9cc813b020 2022-05-02T09:41:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc0005e90 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00072e0 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.264+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc80ae320 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.265+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc80b1560 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.266+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc80ab5c0 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.267+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 52844+0+0 (secure 0 0 0) 0x7f9cc0019030 con 0x7f9cc813b020 2022-05-02T09:41:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.268+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f9cc0058d30 con 0x7f9cc813b020 2022-05-02T09:41:55.274 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.272+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f9cc80ab5c0 con 0x7f9cc813b020 2022-05-02T09:41:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.436+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 --> v1:172.21.15.50:6800/36423 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cc80ab5c0 con 0x7f9ca8044af0 2022-05-02T09:41:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.446+0000 7f9caeffd700 1 -- 172.21.15.50:0/1768514025 <== mgr.14098 v1:172.21.15.50:6800/36423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+268947 (unknown 2965378022 0 1128842806) 0x7f9cc80ab5c0 con 0x7f9ca8044af0 2022-05-02T09:41:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 >> v1:172.21.15.50:6800/36423 conn(0x7f9ca8044af0 legacy=0x7f9ca8046fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 msgr2=0x7f9cc8150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005ad0 tx=0x7f9cc00015b0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 shutdown_connections 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9cc80636c0 0x7f9cc80add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc813b020 0x7f9cc8150900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 --2- 172.21.15.50:0/1768514025 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9cc80b4c80 0x7f9cc80acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 >> 172.21.15.50:0/1768514025 conn(0x7f9cc8069590 msgr2=0x7f9cc81417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 shutdown_connections 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.450+0000 7f9ccd1ff700 1 -- 172.21.15.50:0/1768514025 wait complete. 2022-05-02T09:41:55.456 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:41:55.477 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2022-05-02T09:41:53.579288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8509,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195156,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292204,"statfs":{"total":386547056640,"available":382251216896,"internally_reserved":4294967296,"allocated":839680,"data_stored":260612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3574,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.003396"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777756+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:28.777756+0000","last_peered":"2022-05-02T09:39:28.777756+0000","last_clean":"2022-05-02T09:39:28.777756+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:28.777756+0000","last_undegraded":"2022-05-02T09:39:28.777756+0000","last_fullsized":"2022-05-02T09:39:28.777756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778399+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:28.778399+0000","last_peered":"2022-05-02T09:39:28.778399+0000","last_clean":"2022-05-02T09:39:28.778399+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:28.778399+0000","last_undegraded":"2022-05-02T09:39:28.778399+0000","last_fullsized":"2022-05-02T09:39:28.778399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778093+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:28.778093+0000","last_peered":"2022-05-02T09:39:28.778093+0000","last_clean":"2022-05-02T09:39:28.778093+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:28.778093+0000","last_undegraded":"2022-05-02T09:39:28.778093+0000","last_fullsized":"2022-05-02T09:39:28.778093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777191+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:28.777191+0000","last_peered":"2022-05-02T09:39:28.777191+0000","last_clean":"2022-05-02T09:39:28.777191+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:28.777191+0000","last_undegraded":"2022-05-02T09:39:28.777191+0000","last_fullsized":"2022-05-02T09:39:28.777191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777596+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:28.777596+0000","last_peered":"2022-05-02T09:39:28.777596+0000","last_clean":"2022-05-02T09:39:28.777596+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:28.777596+0000","last_undegraded":"2022-05-02T09:39:28.777596+0000","last_fullsized":"2022-05-02T09:39:28.777596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569723+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:27.569723+0000","last_peered":"2022-05-02T09:39:27.569723+0000","last_clean":"2022-05-02T09:39:27.569723+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:27.569723+0000","last_undegraded":"2022-05-02T09:39:27.569723+0000","last_fullsized":"2022-05-02T09:39:27.569723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569073+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:27.569073+0000","last_peered":"2022-05-02T09:39:27.569073+0000","last_clean":"2022-05-02T09:39:27.569073+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:27.569073+0000","last_undegraded":"2022-05-02T09:39:27.569073+0000","last_fullsized":"2022-05-02T09:39:27.569073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571582+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:27.571582+0000","last_peered":"2022-05-02T09:39:27.571582+0000","last_clean":"2022-05-02T09:39:27.571582+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:27.571582+0000","last_undegraded":"2022-05-02T09:39:27.571582+0000","last_fullsized":"2022-05-02T09:39:27.571582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778517+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:28.778517+0000","last_peered":"2022-05-02T09:39:28.778517+0000","last_clean":"2022-05-02T09:39:28.778517+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:28.778517+0000","last_undegraded":"2022-05-02T09:39:28.778517+0000","last_fullsized":"2022-05-02T09:39:28.778517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572475+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:27.572475+0000","last_peered":"2022-05-02T09:39:27.572475+0000","last_clean":"2022-05-02T09:39:27.572475+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:27.572475+0000","last_undegraded":"2022-05-02T09:39:27.572475+0000","last_fullsized":"2022-05-02T09:39:27.572475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571801+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:27.571801+0000","last_peered":"2022-05-02T09:39:27.571801+0000","last_clean":"2022-05-02T09:39:27.571801+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:27.571801+0000","last_undegraded":"2022-05-02T09:39:27.571801+0000","last_fullsized":"2022-05-02T09:39:27.571801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778191+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:28.778191+0000","last_peered":"2022-05-02T09:39:28.778191+0000","last_clean":"2022-05-02T09:39:28.778191+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:28.778191+0000","last_undegraded":"2022-05-02T09:39:28.778191+0000","last_fullsized":"2022-05-02T09:39:28.778191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777864+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:28.777864+0000","last_peered":"2022-05-02T09:39:28.777864+0000","last_clean":"2022-05-02T09:39:28.777864+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:28.777864+0000","last_undegraded":"2022-05-02T09:39:28.777864+0000","last_fullsized":"2022-05-02T09:39:28.777864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572714+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:27.572714+0000","last_peered":"2022-05-02T09:39:27.572714+0000","last_clean":"2022-05-02T09:39:27.572714+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:27.572714+0000","last_undegraded":"2022-05-02T09:39:27.572714+0000","last_fullsized":"2022-05-02T09:39:27.572714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777352+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:28.777352+0000","last_peered":"2022-05-02T09:39:28.777352+0000","last_clean":"2022-05-02T09:39:28.777352+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:28.777352+0000","last_undegraded":"2022-05-02T09:39:28.777352+0000","last_fullsized":"2022-05-02T09:39:28.777352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568607+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:27.568607+0000","last_peered":"2022-05-02T09:39:27.568607+0000","last_clean":"2022-05-02T09:39:27.568607+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:27.568607+0000","last_undegraded":"2022-05-02T09:39:27.568607+0000","last_fullsized":"2022-05-02T09:39:27.568607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778509+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:28.778509+0000","last_peered":"2022-05-02T09:39:28.778509+0000","last_clean":"2022-05-02T09:39:28.778509+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:28.778509+0000","last_undegraded":"2022-05-02T09:39:28.778509+0000","last_fullsized":"2022-05-02T09:39:28.778509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778556+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:28.778556+0000","last_peered":"2022-05-02T09:39:28.778556+0000","last_clean":"2022-05-02T09:39:28.778556+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:28.778556+0000","last_undegraded":"2022-05-02T09:39:28.778556+0000","last_fullsized":"2022-05-02T09:39:28.778556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777897+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:28.777897+0000","last_peered":"2022-05-02T09:39:28.777897+0000","last_clean":"2022-05-02T09:39:28.777897+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:28.777897+0000","last_undegraded":"2022-05-02T09:39:28.777897+0000","last_fullsized":"2022-05-02T09:39:28.777897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572405+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:27.572405+0000","last_peered":"2022-05-02T09:39:27.572405+0000","last_clean":"2022-05-02T09:39:27.572405+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:27.572405+0000","last_undegraded":"2022-05-02T09:39:27.572405+0000","last_fullsized":"2022-05-02T09:39:27.572405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571070+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:27.571070+0000","last_peered":"2022-05-02T09:39:27.571070+0000","last_clean":"2022-05-02T09:39:27.571070+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:27.571070+0000","last_undegraded":"2022-05-02T09:39:27.571070+0000","last_fullsized":"2022-05-02T09:39:27.571070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777024+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:28.777024+0000","last_peered":"2022-05-02T09:39:28.777024+0000","last_clean":"2022-05-02T09:39:28.777024+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:28.777024+0000","last_undegraded":"2022-05-02T09:39:28.777024+0000","last_fullsized":"2022-05-02T09:39:28.777024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569039+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:27.569039+0000","last_peered":"2022-05-02T09:39:27.569039+0000","last_clean":"2022-05-02T09:39:27.569039+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:27.569039+0000","last_undegraded":"2022-05-02T09:39:27.569039+0000","last_fullsized":"2022-05-02T09:39:27.569039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571730+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:27.571730+0000","last_peered":"2022-05-02T09:39:27.571730+0000","last_clean":"2022-05-02T09:39:27.571730+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:27.571730+0000","last_undegraded":"2022-05-02T09:39:27.571730+0000","last_fullsized":"2022-05-02T09:39:27.571730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571629+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:27.571629+0000","last_peered":"2022-05-02T09:39:27.571629+0000","last_clean":"2022-05-02T09:39:27.571629+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:27.571629+0000","last_undegraded":"2022-05-02T09:39:27.571629+0000","last_fullsized":"2022-05-02T09:39:27.571629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572383+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:27.572383+0000","last_peered":"2022-05-02T09:39:27.572383+0000","last_clean":"2022-05-02T09:39:27.572383+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:27.572383+0000","last_undegraded":"2022-05-02T09:39:27.572383+0000","last_fullsized":"2022-05-02T09:39:27.572383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570273+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:27.570273+0000","last_peered":"2022-05-02T09:39:27.570273+0000","last_clean":"2022-05-02T09:39:27.570273+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:27.570273+0000","last_undegraded":"2022-05-02T09:39:27.570273+0000","last_fullsized":"2022-05-02T09:39:27.570273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571197+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:27.571197+0000","last_peered":"2022-05-02T09:39:27.571197+0000","last_clean":"2022-05-02T09:39:27.571197+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:27.571197+0000","last_undegraded":"2022-05-02T09:39:27.571197+0000","last_fullsized":"2022-05-02T09:39:27.571197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570399+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:27.570399+0000","last_peered":"2022-05-02T09:39:27.570399+0000","last_clean":"2022-05-02T09:39:27.570399+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:27.570399+0000","last_undegraded":"2022-05-02T09:39:27.570399+0000","last_fullsized":"2022-05-02T09:39:27.570399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571581+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:27.571581+0000","last_peered":"2022-05-02T09:39:27.571581+0000","last_clean":"2022-05-02T09:39:27.571581+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:27.571581+0000","last_undegraded":"2022-05-02T09:39:27.571581+0000","last_fullsized":"2022-05-02T09:39:27.571581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778616+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:28.778616+0000","last_peered":"2022-05-02T09:39:28.778616+0000","last_clean":"2022-05-02T09:39:28.778616+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:28.778616+0000","last_undegraded":"2022-05-02T09:39:28.778616+0000","last_fullsized":"2022-05-02T09:39:28.778616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568974+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:27.568974+0000","last_peered":"2022-05-02T09:39:27.568974+0000","last_clean":"2022-05-02T09:39:27.568974+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:27.568974+0000","last_undegraded":"2022-05-02T09:39:27.568974+0000","last_fullsized":"2022-05-02T09:39:27.568974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570863+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:27.570863+0000","last_peered":"2022-05-02T09:39:27.570863+0000","last_clean":"2022-05-02T09:39:27.570863+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:27.570863+0000","last_undegraded":"2022-05-02T09:39:27.570863+0000","last_fullsized":"2022-05-02T09:39:27.570863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:40:00.831109+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:40:00.831109+0000","last_peered":"2022-05-02T09:40:00.831109+0000","last_clean":"2022-05-02T09:40:00.831109+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:40:00.831109+0000","last_undegraded":"2022-05-02T09:40:00.831109+0000","last_fullsized":"2022-05-02T09:40:00.831109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568989+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:27.568989+0000","last_peered":"2022-05-02T09:39:27.568989+0000","last_clean":"2022-05-02T09:39:27.568989+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:27.568989+0000","last_undegraded":"2022-05-02T09:39:27.568989+0000","last_fullsized":"2022-05-02T09:39:27.568989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:28.778064+0000","last_peered":"2022-05-02T09:39:28.778064+0000","last_clean":"2022-05-02T09:39:28.778064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:28.778064+0000","last_undegraded":"2022-05-02T09:39:28.778064+0000","last_fullsized":"2022-05-02T09:39:28.778064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569754+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:27.569754+0000","last_peered":"2022-05-02T09:39:27.569754+0000","last_clean":"2022-05-02T09:39:27.569754+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:27.569754+0000","last_undegraded":"2022-05-02T09:39:27.569754+0000","last_fullsized":"2022-05-02T09:39:27.569754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777990+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:28.777990+0000","last_peered":"2022-05-02T09:39:28.777990+0000","last_clean":"2022-05-02T09:39:28.777990+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:28.777990+0000","last_undegraded":"2022-05-02T09:39:28.777990+0000","last_fullsized":"2022-05-02T09:39:28.777990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572595+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:27.572595+0000","last_peered":"2022-05-02T09:39:27.572595+0000","last_clean":"2022-05-02T09:39:27.572595+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:27.572595+0000","last_undegraded":"2022-05-02T09:39:27.572595+0000","last_fullsized":"2022-05-02T09:39:27.572595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'16","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2022-05-02T09:41:51.695304+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:41:51.695304+0000","last_peered":"2022-05-02T09:41:51.695304+0000","last_clean":"2022-05-02T09:41:51.695304+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:41:51.695304+0000","last_undegraded":"2022-05-02T09:41:51.695304+0000","last_fullsized":"2022-05-02T09:41:51.695304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4741,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777976+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:28.777976+0000","last_peered":"2022-05-02T09:39:28.777976+0000","last_clean":"2022-05-02T09:39:28.777976+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:28.777976+0000","last_undegraded":"2022-05-02T09:39:28.777976+0000","last_fullsized":"2022-05-02T09:39:28.777976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569987+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:27.569987+0000","last_peered":"2022-05-02T09:39:27.569987+0000","last_clean":"2022-05-02T09:39:27.569987+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:27.569987+0000","last_undegraded":"2022-05-02T09:39:27.569987+0000","last_fullsized":"2022-05-02T09:39:27.569987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570645+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:27.570645+0000","last_peered":"2022-05-02T09:39:27.570645+0000","last_clean":"2022-05-02T09:39:27.570645+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:27.570645+0000","last_undegraded":"2022-05-02T09:39:27.570645+0000","last_fullsized":"2022-05-02T09:39:27.570645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777165+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:28.777165+0000","last_peered":"2022-05-02T09:39:28.777165+0000","last_clean":"2022-05-02T09:39:28.777165+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:28.777165+0000","last_undegraded":"2022-05-02T09:39:28.777165+0000","last_fullsized":"2022-05-02T09:39:28.777165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570529+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:27.570529+0000","last_peered":"2022-05-02T09:39:27.570529+0000","last_clean":"2022-05-02T09:39:27.570529+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:27.570529+0000","last_undegraded":"2022-05-02T09:39:27.570529+0000","last_fullsized":"2022-05-02T09:39:27.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569510+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:27.569510+0000","last_peered":"2022-05-02T09:39:27.569510+0000","last_clean":"2022-05-02T09:39:27.569510+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:27.569510+0000","last_undegraded":"2022-05-02T09:39:27.569510+0000","last_fullsized":"2022-05-02T09:39:27.569510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778691+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:28.778691+0000","last_peered":"2022-05-02T09:39:28.778691+0000","last_clean":"2022-05-02T09:39:28.778691+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:28.778691+0000","last_undegraded":"2022-05-02T09:39:28.778691+0000","last_fullsized":"2022-05-02T09:39:28.778691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572241+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:27.572241+0000","last_peered":"2022-05-02T09:39:27.572241+0000","last_clean":"2022-05-02T09:39:27.572241+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:27.572241+0000","last_undegraded":"2022-05-02T09:39:27.572241+0000","last_fullsized":"2022-05-02T09:39:27.572241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570802+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:27.570802+0000","last_peered":"2022-05-02T09:39:27.570802+0000","last_clean":"2022-05-02T09:39:27.570802+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:27.570802+0000","last_undegraded":"2022-05-02T09:39:27.570802+0000","last_fullsized":"2022-05-02T09:39:27.570802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777341+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:28.777341+0000","last_peered":"2022-05-02T09:39:28.777341+0000","last_clean":"2022-05-02T09:39:28.777341+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:28.777341+0000","last_undegraded":"2022-05-02T09:39:28.777341+0000","last_fullsized":"2022-05-02T09:39:28.777341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569129+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:27.569129+0000","last_peered":"2022-05-02T09:39:27.569129+0000","last_clean":"2022-05-02T09:39:27.569129+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:27.569129+0000","last_undegraded":"2022-05-02T09:39:27.569129+0000","last_fullsized":"2022-05-02T09:39:27.569129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778190+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:28.778190+0000","last_peered":"2022-05-02T09:39:28.778190+0000","last_clean":"2022-05-02T09:39:28.778190+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:28.778190+0000","last_undegraded":"2022-05-02T09:39:28.778190+0000","last_fullsized":"2022-05-02T09:39:28.778190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571631+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:27.571631+0000","last_peered":"2022-05-02T09:39:27.571631+0000","last_clean":"2022-05-02T09:39:27.571631+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:27.571631+0000","last_undegraded":"2022-05-02T09:39:27.571631+0000","last_fullsized":"2022-05-02T09:39:27.571631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570662+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:27.570662+0000","last_peered":"2022-05-02T09:39:27.570662+0000","last_clean":"2022-05-02T09:39:27.570662+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:27.570662+0000","last_undegraded":"2022-05-02T09:39:27.570662+0000","last_fullsized":"2022-05-02T09:39:27.570662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777441+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:28.777441+0000","last_peered":"2022-05-02T09:39:28.777441+0000","last_clean":"2022-05-02T09:39:28.777441+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:28.777441+0000","last_undegraded":"2022-05-02T09:39:28.777441+0000","last_fullsized":"2022-05-02T09:39:28.777441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777581+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:28.777581+0000","last_peered":"2022-05-02T09:39:28.777581+0000","last_clean":"2022-05-02T09:39:28.777581+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:28.777581+0000","last_undegraded":"2022-05-02T09:39:28.777581+0000","last_fullsized":"2022-05-02T09:39:28.777581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777856+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:28.777856+0000","last_peered":"2022-05-02T09:39:28.777856+0000","last_clean":"2022-05-02T09:39:28.777856+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:28.777856+0000","last_undegraded":"2022-05-02T09:39:28.777856+0000","last_fullsized":"2022-05-02T09:39:28.777856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569844+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:27.569844+0000","last_peered":"2022-05-02T09:39:27.569844+0000","last_clean":"2022-05-02T09:39:27.569844+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:27.569844+0000","last_undegraded":"2022-05-02T09:39:27.569844+0000","last_fullsized":"2022-05-02T09:39:27.569844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777472+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:28.777472+0000","last_peered":"2022-05-02T09:39:28.777472+0000","last_clean":"2022-05-02T09:39:28.777472+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:28.777472+0000","last_undegraded":"2022-05-02T09:39:28.777472+0000","last_fullsized":"2022-05-02T09:39:28.777472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:50.828629+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:50.828629+0000","last_peered":"2022-05-02T09:39:50.828629+0000","last_clean":"2022-05-02T09:39:50.828629+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:50.828629+0000","last_undegraded":"2022-05-02T09:39:50.828629+0000","last_fullsized":"2022-05-02T09:39:50.828629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570644+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:27.570644+0000","last_peered":"2022-05-02T09:39:27.570644+0000","last_clean":"2022-05-02T09:39:27.570644+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:27.570644+0000","last_undegraded":"2022-05-02T09:39:27.570644+0000","last_fullsized":"2022-05-02T09:39:27.570644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569232+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:27.569232+0000","last_peered":"2022-05-02T09:39:27.569232+0000","last_clean":"2022-05-02T09:39:27.569232+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:27.569232+0000","last_undegraded":"2022-05-02T09:39:27.569232+0000","last_fullsized":"2022-05-02T09:39:27.569232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778320+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:28.778320+0000","last_peered":"2022-05-02T09:39:28.778320+0000","last_clean":"2022-05-02T09:39:28.778320+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:28.778320+0000","last_undegraded":"2022-05-02T09:39:28.778320+0000","last_fullsized":"2022-05-02T09:39:28.778320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568705+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:27.568705+0000","last_peered":"2022-05-02T09:39:27.568705+0000","last_clean":"2022-05-02T09:39:27.568705+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:27.568705+0000","last_undegraded":"2022-05-02T09:39:27.568705+0000","last_fullsized":"2022-05-02T09:39:27.568705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571785+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:27.571785+0000","last_peered":"2022-05-02T09:39:27.571785+0000","last_clean":"2022-05-02T09:39:27.571785+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:27.571785+0000","last_undegraded":"2022-05-02T09:39:27.571785+0000","last_fullsized":"2022-05-02T09:39:27.571785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572286+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:27.572286+0000","last_peered":"2022-05-02T09:39:27.572286+0000","last_clean":"2022-05-02T09:39:27.572286+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:27.572286+0000","last_undegraded":"2022-05-02T09:39:27.572286+0000","last_fullsized":"2022-05-02T09:39:27.572286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778035+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:28.778035+0000","last_peered":"2022-05-02T09:39:28.778035+0000","last_clean":"2022-05-02T09:39:28.778035+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:28.778035+0000","last_undegraded":"2022-05-02T09:39:28.778035+0000","last_fullsized":"2022-05-02T09:39:28.778035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571464+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:27.571464+0000","last_peered":"2022-05-02T09:39:27.571464+0000","last_clean":"2022-05-02T09:39:27.571464+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:27.571464+0000","last_undegraded":"2022-05-02T09:39:27.571464+0000","last_fullsized":"2022-05-02T09:39:27.571464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569593+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:27.569593+0000","last_peered":"2022-05-02T09:39:27.569593+0000","last_clean":"2022-05-02T09:39:27.569593+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:27.569593+0000","last_undegraded":"2022-05-02T09:39:27.569593+0000","last_fullsized":"2022-05-02T09:39:27.569593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:55.828597+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:55.828597+0000","last_peered":"2022-05-02T09:39:55.828597+0000","last_clean":"2022-05-02T09:39:55.828597+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:55.828597+0000","last_undegraded":"2022-05-02T09:39:55.828597+0000","last_fullsized":"2022-05-02T09:39:55.828597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571888+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:27.571888+0000","last_peered":"2022-05-02T09:39:27.571888+0000","last_clean":"2022-05-02T09:39:27.571888+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:27.571888+0000","last_undegraded":"2022-05-02T09:39:27.571888+0000","last_fullsized":"2022-05-02T09:39:27.571888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777603+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:28.777603+0000","last_peered":"2022-05-02T09:39:28.777603+0000","last_clean":"2022-05-02T09:39:28.777603+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:28.777603+0000","last_undegraded":"2022-05-02T09:39:28.777603+0000","last_fullsized":"2022-05-02T09:39:28.777603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572071+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:27.572071+0000","last_peered":"2022-05-02T09:39:27.572071+0000","last_clean":"2022-05-02T09:39:27.572071+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:27.572071+0000","last_undegraded":"2022-05-02T09:39:27.572071+0000","last_fullsized":"2022-05-02T09:39:27.572071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571927+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:27.571927+0000","last_peered":"2022-05-02T09:39:27.571927+0000","last_clean":"2022-05-02T09:39:27.571927+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:27.571927+0000","last_undegraded":"2022-05-02T09:39:27.571927+0000","last_fullsized":"2022-05-02T09:39:27.571927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570469+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:27.570469+0000","last_peered":"2022-05-02T09:39:27.570469+0000","last_clean":"2022-05-02T09:39:27.570469+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:27.570469+0000","last_undegraded":"2022-05-02T09:39:27.570469+0000","last_fullsized":"2022-05-02T09:39:27.570469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571868+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:27.571868+0000","last_peered":"2022-05-02T09:39:27.571868+0000","last_clean":"2022-05-02T09:39:27.571868+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:27.571868+0000","last_undegraded":"2022-05-02T09:39:27.571868+0000","last_fullsized":"2022-05-02T09:39:27.571868+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569457+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:27.569457+0000","last_peered":"2022-05-02T09:39:27.569457+0000","last_clean":"2022-05-02T09:39:27.569457+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:27.569457+0000","last_undegraded":"2022-05-02T09:39:27.569457+0000","last_fullsized":"2022-05-02T09:39:27.569457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571028+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:27.571028+0000","last_peered":"2022-05-02T09:39:27.571028+0000","last_clean":"2022-05-02T09:39:27.571028+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:27.571028+0000","last_undegraded":"2022-05-02T09:39:27.571028+0000","last_fullsized":"2022-05-02T09:39:27.571028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568833+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:27.568833+0000","last_peered":"2022-05-02T09:39:27.568833+0000","last_clean":"2022-05-02T09:39:27.568833+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:27.568833+0000","last_undegraded":"2022-05-02T09:39:27.568833+0000","last_fullsized":"2022-05-02T09:39:27.568833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777242+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:28.777242+0000","last_peered":"2022-05-02T09:39:28.777242+0000","last_clean":"2022-05-02T09:39:28.777242+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:28.777242+0000","last_undegraded":"2022-05-02T09:39:28.777242+0000","last_fullsized":"2022-05-02T09:39:28.777242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778750+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:28.778750+0000","last_peered":"2022-05-02T09:39:28.778750+0000","last_clean":"2022-05-02T09:39:28.778750+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:28.778750+0000","last_undegraded":"2022-05-02T09:39:28.778750+0000","last_fullsized":"2022-05-02T09:39:28.778750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570805+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:27.570805+0000","last_peered":"2022-05-02T09:39:27.570805+0000","last_clean":"2022-05-02T09:39:27.570805+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:27.570805+0000","last_undegraded":"2022-05-02T09:39:27.570805+0000","last_fullsized":"2022-05-02T09:39:27.570805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571763+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:27.571763+0000","last_peered":"2022-05-02T09:39:27.571763+0000","last_clean":"2022-05-02T09:39:27.571763+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:27.571763+0000","last_undegraded":"2022-05-02T09:39:27.571763+0000","last_fullsized":"2022-05-02T09:39:27.571763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777799+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:28.777799+0000","last_peered":"2022-05-02T09:39:28.777799+0000","last_clean":"2022-05-02T09:39:28.777799+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:28.777799+0000","last_undegraded":"2022-05-02T09:39:28.777799+0000","last_fullsized":"2022-05-02T09:39:28.777799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570643+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:27.570643+0000","last_peered":"2022-05-02T09:39:27.570643+0000","last_clean":"2022-05-02T09:39:27.570643+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:27.570643+0000","last_undegraded":"2022-05-02T09:39:27.570643+0000","last_fullsized":"2022-05-02T09:39:27.570643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572355+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:27.572355+0000","last_peered":"2022-05-02T09:39:27.572355+0000","last_clean":"2022-05-02T09:39:27.572355+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:27.572355+0000","last_undegraded":"2022-05-02T09:39:27.572355+0000","last_fullsized":"2022-05-02T09:39:27.572355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568766+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:27.568766+0000","last_peered":"2022-05-02T09:39:27.568766+0000","last_clean":"2022-05-02T09:39:27.568766+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:27.568766+0000","last_undegraded":"2022-05-02T09:39:27.568766+0000","last_fullsized":"2022-05-02T09:39:27.568766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570543+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:27.570543+0000","last_peered":"2022-05-02T09:39:27.570543+0000","last_clean":"2022-05-02T09:39:27.570543+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:27.570543+0000","last_undegraded":"2022-05-02T09:39:27.570543+0000","last_fullsized":"2022-05-02T09:39:27.570543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:45.831699+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:45.831699+0000","last_peered":"2022-05-02T09:39:45.831699+0000","last_clean":"2022-05-02T09:39:45.831699+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:45.831699+0000","last_undegraded":"2022-05-02T09:39:45.831699+0000","last_fullsized":"2022-05-02T09:39:45.831699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:28.777426+0000","last_peered":"2022-05-02T09:39:28.777426+0000","last_clean":"2022-05-02T09:39:28.777426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:28.777426+0000","last_undegraded":"2022-05-02T09:39:28.777426+0000","last_fullsized":"2022-05-02T09:39:28.777426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"20'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:50.829318+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:50.829318+0000","last_peered":"2022-05-02T09:39:50.829318+0000","last_clean":"2022-05-02T09:39:50.829318+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:50.829318+0000","last_undegraded":"2022-05-02T09:39:50.829318+0000","last_fullsized":"2022-05-02T09:39:50.829318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778263+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:28.778263+0000","last_peered":"2022-05-02T09:39:28.778263+0000","last_clean":"2022-05-02T09:39:28.778263+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:28.778263+0000","last_undegraded":"2022-05-02T09:39:28.778263+0000","last_fullsized":"2022-05-02T09:39:28.778263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572023+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:27.572023+0000","last_peered":"2022-05-02T09:39:27.572023+0000","last_clean":"2022-05-02T09:39:27.572023+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:27.572023+0000","last_undegraded":"2022-05-02T09:39:27.572023+0000","last_fullsized":"2022-05-02T09:39:27.572023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777995+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:28.777995+0000","last_peered":"2022-05-02T09:39:28.777995+0000","last_clean":"2022-05-02T09:39:28.777995+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:28.777995+0000","last_undegraded":"2022-05-02T09:39:28.777995+0000","last_fullsized":"2022-05-02T09:39:28.777995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570913+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:27.570913+0000","last_peered":"2022-05-02T09:39:27.570913+0000","last_clean":"2022-05-02T09:39:27.570913+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:27.570913+0000","last_undegraded":"2022-05-02T09:39:27.570913+0000","last_fullsized":"2022-05-02T09:39:27.570913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777323+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:28.777323+0000","last_peered":"2022-05-02T09:39:28.777323+0000","last_clean":"2022-05-02T09:39:28.777323+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:28.777323+0000","last_undegraded":"2022-05-02T09:39:28.777323+0000","last_fullsized":"2022-05-02T09:39:28.777323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570323+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:27.570323+0000","last_peered":"2022-05-02T09:39:27.570323+0000","last_clean":"2022-05-02T09:39:27.570323+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:27.570323+0000","last_undegraded":"2022-05-02T09:39:27.570323+0000","last_fullsized":"2022-05-02T09:39:27.570323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569897+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:27.569897+0000","last_peered":"2022-05-02T09:39:27.569897+0000","last_clean":"2022-05-02T09:39:27.569897+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:27.569897+0000","last_undegraded":"2022-05-02T09:39:27.569897+0000","last_fullsized":"2022-05-02T09:39:27.569897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778245+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:28.778245+0000","last_peered":"2022-05-02T09:39:28.778245+0000","last_clean":"2022-05-02T09:39:28.778245+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:28.778245+0000","last_undegraded":"2022-05-02T09:39:28.778245+0000","last_fullsized":"2022-05-02T09:39:28.778245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.776985+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:28.776985+0000","last_peered":"2022-05-02T09:39:28.776985+0000","last_clean":"2022-05-02T09:39:28.776985+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:28.776985+0000","last_undegraded":"2022-05-02T09:39:28.776985+0000","last_fullsized":"2022-05-02T09:39:28.776985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572205+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:27.572205+0000","last_peered":"2022-05-02T09:39:27.572205+0000","last_clean":"2022-05-02T09:39:27.572205+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:27.572205+0000","last_undegraded":"2022-05-02T09:39:27.572205+0000","last_fullsized":"2022-05-02T09:39:27.572205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569220+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:27.569220+0000","last_peered":"2022-05-02T09:39:27.569220+0000","last_clean":"2022-05-02T09:39:27.569220+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:27.569220+0000","last_undegraded":"2022-05-02T09:39:27.569220+0000","last_fullsized":"2022-05-02T09:39:27.569220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777196+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:28.777196+0000","last_peered":"2022-05-02T09:39:28.777196+0000","last_clean":"2022-05-02T09:39:28.777196+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:28.777196+0000","last_undegraded":"2022-05-02T09:39:28.777196+0000","last_fullsized":"2022-05-02T09:39:28.777196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570112+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:27.570112+0000","last_peered":"2022-05-02T09:39:27.570112+0000","last_clean":"2022-05-02T09:39:27.570112+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:27.570112+0000","last_undegraded":"2022-05-02T09:39:27.570112+0000","last_fullsized":"2022-05-02T09:39:27.570112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572169+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:27.572169+0000","last_peered":"2022-05-02T09:39:27.572169+0000","last_clean":"2022-05-02T09:39:27.572169+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:27.572169+0000","last_undegraded":"2022-05-02T09:39:27.572169+0000","last_fullsized":"2022-05-02T09:39:27.572169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8509,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672996,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":65156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.47499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.371}]},{"osd":1,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.53100000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.60999999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.439,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51800000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672996,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40899999999999997,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.48699999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.50800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.46400000000000002,"15min":0.47899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61799999999999999,"5min":1.274,"15min":1.274},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.5,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.37},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.57999999999999996,"5min":1.228,"15min":1.228},"last":0.36499999999999999}]}]},{"osd":3,"up_from":10,"seq":42949672996,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":69031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.25},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49399999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31}]},{"osd":1,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42999999999999999,"15min":0.436},"min":{"1min":0.313,"5min":0.309,"15min":0.309},"max":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.53000000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54700000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.34300000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672996,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":64683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63800000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54700000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57999999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.626},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48799999999999999,"15min":0.49399999999999999},"min":{"1min":0.38500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.61099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-02T09:41:55.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:41:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.744+0000 7f97f49fe700 1 Processor -- start 2022-05-02T09:41:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.744+0000 7f97f49fe700 1 -- start start 2022-05-02T09:41:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f01415e0 0x7f97f013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97f00a9bc0 0x7f97f013b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f0063a90 con 0x7f97f00a9bc0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00a8eb0 con 0x7f97f00636c0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97f49fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0141a70 con 0x7f97f01415e0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97eed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97ef59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97f00a9bc0 0x7f97f013b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97ee59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f01415e0 0x7f97f013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97eed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50646/0 (socket says 172.21.15.50:50646) 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.745+0000 7f97eed9d700 1 -- 172.21.15.50:0/3670166314 learned_addr learned my addr 172.21.15.50:0/3670166314 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 -- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f01415e0 msgr2=0x7f97f013ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 --2- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f01415e0 0x7f97f013ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 -- 172.21.15.50:0/3670166314 >> v2:172.21.15.50:3300/0 conn(0x7f97f00a9bc0 msgr2=0x7f97f013b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 --2- 172.21.15.50:0/3670166314 >> v2:172.21.15.50:3300/0 conn(0x7f97f00a9bc0 0x7f97f013b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 -- 172.21.15.50:0/3670166314 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0141d30 con 0x7f97f00636c0 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97eed9d700 1 --2- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009810 tx=0x7f97e0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c386e4c48e904f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97edd9b700 1 -- 172.21.15.50:0/3670166314 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0005a90 con 0x7f97f00636c0 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97edd9b700 1 -- 172.21.15.50:0/3670166314 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0005bf0 con 0x7f97f00636c0 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.746+0000 7f97edd9b700 1 -- 172.21.15.50:0/3670166314 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0006030 con 0x7f97f00636c0 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 -- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 msgr2=0x7f97f01410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 --2- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009810 tx=0x7f97e0009060 comp rx=0 tx=0).stop 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 -- 172.21.15.50:0/3670166314 shutdown_connections 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 --2- 172.21.15.50:0/3670166314 >> v2:172.21.15.50:3300/0 conn(0x7f97f00a9bc0 0x7f97f013b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 --2- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f00636c0 0x7f97f01410a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 --2- 172.21.15.50:0/3670166314 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f01415e0 0x7f97f013ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 -- 172.21.15.50:0/3670166314 >> 172.21.15.50:0/3670166314 conn(0x7f97f0069370 msgr2=0x7f97f0062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 -- 172.21.15.50:0/3670166314 shutdown_connections 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.747+0000 7f97f49fe700 1 -- 172.21.15.50:0/3670166314 wait complete. 2022-05-02T09:41:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.749+0000 7f97f49fe700 1 Processor -- start 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.750+0000 7f97f49fe700 1 -- start start 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 0x7f97f00adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 0x7f97f01395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00ab280 con 0x7f97f00636c0 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00ad4c0 con 0x7f97f01415e0 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97f49fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00acb20 con 0x7f97f00a9bc0 2022-05-02T09:41:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97eed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97ee59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 0x7f97f00adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97eed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36102/0 (socket says 172.21.15.50:36102) 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97eed9d700 1 -- 172.21.15.50:0/235455132 learned_addr learned my addr 172.21.15.50:0/235455132 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97ee59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 0x7f97f00adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49984/0 (socket says 172.21.15.50:49984) 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.751+0000 7f97ef59e700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 0x7f97f01395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 -- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 msgr2=0x7f97f00adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 0x7f97f00adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 -- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 msgr2=0x7f97f01395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 0x7f97f01395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 -- 172.21.15.50:0/235455132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0009300 con 0x7f97f00636c0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97ef59e700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 0x7f97f01395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97eed9d700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e00 tx=0x7f97e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e001a630 con 0x7f97f00636c0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e001a790 con 0x7f97f00636c0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00ad1e0 con 0x7f97f00636c0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e001ab50 con 0x7f97f00636c0 2022-05-02T09:41:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.752+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f00aa770 con 0x7f97f00636c0 2022-05-02T09:41:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.753+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00a6ca0 con 0x7f97f00636c0 2022-05-02T09:41:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.754+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f97e002d070 con 0x7f97f00636c0 2022-05-02T09:41:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.754+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f97e005aa90 con 0x7f97f00636c0 2022-05-02T09:41:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.758+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f97e0026430 con 0x7f97f00636c0 2022-05-02T09:41:55.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.912+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 --> v1:172.21.15.50:6800/36423 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97f004b770 con 0x7f97d0044b40 2022-05-02T09:41:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.920+0000 7f97d6ffd700 1 -- 172.21.15.50:0/235455132 <== mgr.14098 v1:172.21.15.50:6800/36423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+268947 (unknown 2965378022 0 953859377) 0x7f97f004b770 con 0x7f97d0044b40 2022-05-02T09:41:55.929 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.924+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 >> v1:172.21.15.50:6800/36423 conn(0x7f97d0044b40 legacy=0x7f97d0046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.924+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 msgr2=0x7f97f00b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.924+0000 7f97f49fe700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e00 tx=0x7f97e0016000 comp rx=0 tx=0).stop 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 shutdown_connections 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97f01415e0 0x7f97f01395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97f00636c0 0x7f97f00b12a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 --2- 172.21.15.50:0/235455132 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f97f00a9bc0 0x7f97f00adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 >> 172.21.15.50:0/235455132 conn(0x7f97f0069370 msgr2=0x7f97f013b730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 shutdown_connections 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:55.925+0000 7f97f49fe700 1 -- 172.21.15.50:0/235455132 wait complete. 2022-05-02T09:41:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:41:55.952 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2022-05-02T09:41:55.576565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8509,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195156,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292204,"statfs":{"total":386547056640,"available":382251216896,"internally_reserved":4294967296,"allocated":839680,"data_stored":260612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3574,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.000673"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777756+0000","last_change":"2022-05-02T09:39:11.337759+0000","last_active":"2022-05-02T09:39:28.777756+0000","last_peered":"2022-05-02T09:39:28.777756+0000","last_clean":"2022-05-02T09:39:28.777756+0000","last_became_active":"2022-05-02T09:39:11.337283+0000","last_became_peered":"2022-05-02T09:39:11.337283+0000","last_unstale":"2022-05-02T09:39:28.777756+0000","last_undegraded":"2022-05-02T09:39:28.777756+0000","last_fullsized":"2022-05-02T09:39:28.777756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778399+0000","last_change":"2022-05-02T09:39:11.366775+0000","last_active":"2022-05-02T09:39:28.778399+0000","last_peered":"2022-05-02T09:39:28.778399+0000","last_clean":"2022-05-02T09:39:28.778399+0000","last_became_active":"2022-05-02T09:39:11.366447+0000","last_became_peered":"2022-05-02T09:39:11.366447+0000","last_unstale":"2022-05-02T09:39:28.778399+0000","last_undegraded":"2022-05-02T09:39:28.778399+0000","last_fullsized":"2022-05-02T09:39:28.778399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778093+0000","last_change":"2022-05-02T09:39:11.366485+0000","last_active":"2022-05-02T09:39:28.778093+0000","last_peered":"2022-05-02T09:39:28.778093+0000","last_clean":"2022-05-02T09:39:28.778093+0000","last_became_active":"2022-05-02T09:39:11.366147+0000","last_became_peered":"2022-05-02T09:39:11.366147+0000","last_unstale":"2022-05-02T09:39:28.778093+0000","last_undegraded":"2022-05-02T09:39:28.778093+0000","last_fullsized":"2022-05-02T09:39:28.778093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777191+0000","last_change":"2022-05-02T09:39:11.362875+0000","last_active":"2022-05-02T09:39:28.777191+0000","last_peered":"2022-05-02T09:39:28.777191+0000","last_clean":"2022-05-02T09:39:28.777191+0000","last_became_active":"2022-05-02T09:39:11.362530+0000","last_became_peered":"2022-05-02T09:39:11.362530+0000","last_unstale":"2022-05-02T09:39:28.777191+0000","last_undegraded":"2022-05-02T09:39:28.777191+0000","last_fullsized":"2022-05-02T09:39:28.777191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777596+0000","last_change":"2022-05-02T09:39:11.349274+0000","last_active":"2022-05-02T09:39:28.777596+0000","last_peered":"2022-05-02T09:39:28.777596+0000","last_clean":"2022-05-02T09:39:28.777596+0000","last_became_active":"2022-05-02T09:39:11.348940+0000","last_became_peered":"2022-05-02T09:39:11.348940+0000","last_unstale":"2022-05-02T09:39:28.777596+0000","last_undegraded":"2022-05-02T09:39:28.777596+0000","last_fullsized":"2022-05-02T09:39:28.777596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569723+0000","last_change":"2022-05-02T09:39:11.325561+0000","last_active":"2022-05-02T09:39:27.569723+0000","last_peered":"2022-05-02T09:39:27.569723+0000","last_clean":"2022-05-02T09:39:27.569723+0000","last_became_active":"2022-05-02T09:39:11.325219+0000","last_became_peered":"2022-05-02T09:39:11.325219+0000","last_unstale":"2022-05-02T09:39:27.569723+0000","last_undegraded":"2022-05-02T09:39:27.569723+0000","last_fullsized":"2022-05-02T09:39:27.569723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569073+0000","last_change":"2022-05-02T09:39:11.353044+0000","last_active":"2022-05-02T09:39:27.569073+0000","last_peered":"2022-05-02T09:39:27.569073+0000","last_clean":"2022-05-02T09:39:27.569073+0000","last_became_active":"2022-05-02T09:39:11.351656+0000","last_became_peered":"2022-05-02T09:39:11.351656+0000","last_unstale":"2022-05-02T09:39:27.569073+0000","last_undegraded":"2022-05-02T09:39:27.569073+0000","last_fullsized":"2022-05-02T09:39:27.569073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571582+0000","last_change":"2022-05-02T09:39:11.356675+0000","last_active":"2022-05-02T09:39:27.571582+0000","last_peered":"2022-05-02T09:39:27.571582+0000","last_clean":"2022-05-02T09:39:27.571582+0000","last_became_active":"2022-05-02T09:39:11.356127+0000","last_became_peered":"2022-05-02T09:39:11.356127+0000","last_unstale":"2022-05-02T09:39:27.571582+0000","last_undegraded":"2022-05-02T09:39:27.571582+0000","last_fullsized":"2022-05-02T09:39:27.571582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778517+0000","last_change":"2022-05-02T09:39:11.350022+0000","last_active":"2022-05-02T09:39:28.778517+0000","last_peered":"2022-05-02T09:39:28.778517+0000","last_clean":"2022-05-02T09:39:28.778517+0000","last_became_active":"2022-05-02T09:39:11.349698+0000","last_became_peered":"2022-05-02T09:39:11.349698+0000","last_unstale":"2022-05-02T09:39:28.778517+0000","last_undegraded":"2022-05-02T09:39:28.778517+0000","last_fullsized":"2022-05-02T09:39:28.778517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572475+0000","last_change":"2022-05-02T09:39:11.355124+0000","last_active":"2022-05-02T09:39:27.572475+0000","last_peered":"2022-05-02T09:39:27.572475+0000","last_clean":"2022-05-02T09:39:27.572475+0000","last_became_active":"2022-05-02T09:39:11.354761+0000","last_became_peered":"2022-05-02T09:39:11.354761+0000","last_unstale":"2022-05-02T09:39:27.572475+0000","last_undegraded":"2022-05-02T09:39:27.572475+0000","last_fullsized":"2022-05-02T09:39:27.572475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571801+0000","last_change":"2022-05-02T09:39:11.353797+0000","last_active":"2022-05-02T09:39:27.571801+0000","last_peered":"2022-05-02T09:39:27.571801+0000","last_clean":"2022-05-02T09:39:27.571801+0000","last_became_active":"2022-05-02T09:39:11.353440+0000","last_became_peered":"2022-05-02T09:39:11.353440+0000","last_unstale":"2022-05-02T09:39:27.571801+0000","last_undegraded":"2022-05-02T09:39:27.571801+0000","last_fullsized":"2022-05-02T09:39:27.571801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778191+0000","last_change":"2022-05-02T09:39:11.340487+0000","last_active":"2022-05-02T09:39:28.778191+0000","last_peered":"2022-05-02T09:39:28.778191+0000","last_clean":"2022-05-02T09:39:28.778191+0000","last_became_active":"2022-05-02T09:39:11.338977+0000","last_became_peered":"2022-05-02T09:39:11.338977+0000","last_unstale":"2022-05-02T09:39:28.778191+0000","last_undegraded":"2022-05-02T09:39:28.778191+0000","last_fullsized":"2022-05-02T09:39:28.778191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777864+0000","last_change":"2022-05-02T09:39:11.338688+0000","last_active":"2022-05-02T09:39:28.777864+0000","last_peered":"2022-05-02T09:39:28.777864+0000","last_clean":"2022-05-02T09:39:28.777864+0000","last_became_active":"2022-05-02T09:39:11.338094+0000","last_became_peered":"2022-05-02T09:39:11.338094+0000","last_unstale":"2022-05-02T09:39:28.777864+0000","last_undegraded":"2022-05-02T09:39:28.777864+0000","last_fullsized":"2022-05-02T09:39:28.777864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572714+0000","last_change":"2022-05-02T09:39:11.335867+0000","last_active":"2022-05-02T09:39:27.572714+0000","last_peered":"2022-05-02T09:39:27.572714+0000","last_clean":"2022-05-02T09:39:27.572714+0000","last_became_active":"2022-05-02T09:39:11.331532+0000","last_became_peered":"2022-05-02T09:39:11.331532+0000","last_unstale":"2022-05-02T09:39:27.572714+0000","last_undegraded":"2022-05-02T09:39:27.572714+0000","last_fullsized":"2022-05-02T09:39:27.572714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777352+0000","last_change":"2022-05-02T09:39:11.363410+0000","last_active":"2022-05-02T09:39:28.777352+0000","last_peered":"2022-05-02T09:39:28.777352+0000","last_clean":"2022-05-02T09:39:28.777352+0000","last_became_active":"2022-05-02T09:39:11.363064+0000","last_became_peered":"2022-05-02T09:39:11.363064+0000","last_unstale":"2022-05-02T09:39:28.777352+0000","last_undegraded":"2022-05-02T09:39:28.777352+0000","last_fullsized":"2022-05-02T09:39:28.777352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568607+0000","last_change":"2022-05-02T09:39:11.351512+0000","last_active":"2022-05-02T09:39:27.568607+0000","last_peered":"2022-05-02T09:39:27.568607+0000","last_clean":"2022-05-02T09:39:27.568607+0000","last_became_active":"2022-05-02T09:39:11.351039+0000","last_became_peered":"2022-05-02T09:39:11.351039+0000","last_unstale":"2022-05-02T09:39:27.568607+0000","last_undegraded":"2022-05-02T09:39:27.568607+0000","last_fullsized":"2022-05-02T09:39:27.568607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778509+0000","last_change":"2022-05-02T09:39:11.349531+0000","last_active":"2022-05-02T09:39:28.778509+0000","last_peered":"2022-05-02T09:39:28.778509+0000","last_clean":"2022-05-02T09:39:28.778509+0000","last_became_active":"2022-05-02T09:39:11.348324+0000","last_became_peered":"2022-05-02T09:39:11.348324+0000","last_unstale":"2022-05-02T09:39:28.778509+0000","last_undegraded":"2022-05-02T09:39:28.778509+0000","last_fullsized":"2022-05-02T09:39:28.778509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778556+0000","last_change":"2022-05-02T09:39:11.361072+0000","last_active":"2022-05-02T09:39:28.778556+0000","last_peered":"2022-05-02T09:39:28.778556+0000","last_clean":"2022-05-02T09:39:28.778556+0000","last_became_active":"2022-05-02T09:39:11.360756+0000","last_became_peered":"2022-05-02T09:39:11.360756+0000","last_unstale":"2022-05-02T09:39:28.778556+0000","last_undegraded":"2022-05-02T09:39:28.778556+0000","last_fullsized":"2022-05-02T09:39:28.778556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777897+0000","last_change":"2022-05-02T09:39:11.340138+0000","last_active":"2022-05-02T09:39:28.777897+0000","last_peered":"2022-05-02T09:39:28.777897+0000","last_clean":"2022-05-02T09:39:28.777897+0000","last_became_active":"2022-05-02T09:39:11.338922+0000","last_became_peered":"2022-05-02T09:39:11.338922+0000","last_unstale":"2022-05-02T09:39:28.777897+0000","last_undegraded":"2022-05-02T09:39:28.777897+0000","last_fullsized":"2022-05-02T09:39:28.777897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572405+0000","last_change":"2022-05-02T09:39:11.347592+0000","last_active":"2022-05-02T09:39:27.572405+0000","last_peered":"2022-05-02T09:39:27.572405+0000","last_clean":"2022-05-02T09:39:27.572405+0000","last_became_active":"2022-05-02T09:39:11.347258+0000","last_became_peered":"2022-05-02T09:39:11.347258+0000","last_unstale":"2022-05-02T09:39:27.572405+0000","last_undegraded":"2022-05-02T09:39:27.572405+0000","last_fullsized":"2022-05-02T09:39:27.572405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571070+0000","last_change":"2022-05-02T09:39:11.346965+0000","last_active":"2022-05-02T09:39:27.571070+0000","last_peered":"2022-05-02T09:39:27.571070+0000","last_clean":"2022-05-02T09:39:27.571070+0000","last_became_active":"2022-05-02T09:39:11.346557+0000","last_became_peered":"2022-05-02T09:39:11.346557+0000","last_unstale":"2022-05-02T09:39:27.571070+0000","last_undegraded":"2022-05-02T09:39:27.571070+0000","last_fullsized":"2022-05-02T09:39:27.571070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777024+0000","last_change":"2022-05-02T09:39:11.362750+0000","last_active":"2022-05-02T09:39:28.777024+0000","last_peered":"2022-05-02T09:39:28.777024+0000","last_clean":"2022-05-02T09:39:28.777024+0000","last_became_active":"2022-05-02T09:39:11.362353+0000","last_became_peered":"2022-05-02T09:39:11.362353+0000","last_unstale":"2022-05-02T09:39:28.777024+0000","last_undegraded":"2022-05-02T09:39:28.777024+0000","last_fullsized":"2022-05-02T09:39:28.777024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569039+0000","last_change":"2022-05-02T09:39:11.352629+0000","last_active":"2022-05-02T09:39:27.569039+0000","last_peered":"2022-05-02T09:39:27.569039+0000","last_clean":"2022-05-02T09:39:27.569039+0000","last_became_active":"2022-05-02T09:39:11.351927+0000","last_became_peered":"2022-05-02T09:39:11.351927+0000","last_unstale":"2022-05-02T09:39:27.569039+0000","last_undegraded":"2022-05-02T09:39:27.569039+0000","last_fullsized":"2022-05-02T09:39:27.569039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571730+0000","last_change":"2022-05-02T09:39:11.337447+0000","last_active":"2022-05-02T09:39:27.571730+0000","last_peered":"2022-05-02T09:39:27.571730+0000","last_clean":"2022-05-02T09:39:27.571730+0000","last_became_active":"2022-05-02T09:39:11.336937+0000","last_became_peered":"2022-05-02T09:39:11.336937+0000","last_unstale":"2022-05-02T09:39:27.571730+0000","last_undegraded":"2022-05-02T09:39:27.571730+0000","last_fullsized":"2022-05-02T09:39:27.571730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571629+0000","last_change":"2022-05-02T09:39:11.342907+0000","last_active":"2022-05-02T09:39:27.571629+0000","last_peered":"2022-05-02T09:39:27.571629+0000","last_clean":"2022-05-02T09:39:27.571629+0000","last_became_active":"2022-05-02T09:39:11.342441+0000","last_became_peered":"2022-05-02T09:39:11.342441+0000","last_unstale":"2022-05-02T09:39:27.571629+0000","last_undegraded":"2022-05-02T09:39:27.571629+0000","last_fullsized":"2022-05-02T09:39:27.571629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572383+0000","last_change":"2022-05-02T09:39:11.349174+0000","last_active":"2022-05-02T09:39:27.572383+0000","last_peered":"2022-05-02T09:39:27.572383+0000","last_clean":"2022-05-02T09:39:27.572383+0000","last_became_active":"2022-05-02T09:39:11.348727+0000","last_became_peered":"2022-05-02T09:39:11.348727+0000","last_unstale":"2022-05-02T09:39:27.572383+0000","last_undegraded":"2022-05-02T09:39:27.572383+0000","last_fullsized":"2022-05-02T09:39:27.572383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570273+0000","last_change":"2022-05-02T09:39:11.355307+0000","last_active":"2022-05-02T09:39:27.570273+0000","last_peered":"2022-05-02T09:39:27.570273+0000","last_clean":"2022-05-02T09:39:27.570273+0000","last_became_active":"2022-05-02T09:39:11.352265+0000","last_became_peered":"2022-05-02T09:39:11.352265+0000","last_unstale":"2022-05-02T09:39:27.570273+0000","last_undegraded":"2022-05-02T09:39:27.570273+0000","last_fullsized":"2022-05-02T09:39:27.570273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571197+0000","last_change":"2022-05-02T09:39:10.889853+0000","last_active":"2022-05-02T09:39:27.571197+0000","last_peered":"2022-05-02T09:39:27.571197+0000","last_clean":"2022-05-02T09:39:27.571197+0000","last_became_active":"2022-05-02T09:39:10.889418+0000","last_became_peered":"2022-05-02T09:39:10.889418+0000","last_unstale":"2022-05-02T09:39:27.571197+0000","last_undegraded":"2022-05-02T09:39:27.571197+0000","last_fullsized":"2022-05-02T09:39:27.571197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570399+0000","last_change":"2022-05-02T09:39:11.368390+0000","last_active":"2022-05-02T09:39:27.570399+0000","last_peered":"2022-05-02T09:39:27.570399+0000","last_clean":"2022-05-02T09:39:27.570399+0000","last_became_active":"2022-05-02T09:39:11.368043+0000","last_became_peered":"2022-05-02T09:39:11.368043+0000","last_unstale":"2022-05-02T09:39:27.570399+0000","last_undegraded":"2022-05-02T09:39:27.570399+0000","last_fullsized":"2022-05-02T09:39:27.570399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571581+0000","last_change":"2022-05-02T09:39:10.898911+0000","last_active":"2022-05-02T09:39:27.571581+0000","last_peered":"2022-05-02T09:39:27.571581+0000","last_clean":"2022-05-02T09:39:27.571581+0000","last_became_active":"2022-05-02T09:39:10.898572+0000","last_became_peered":"2022-05-02T09:39:10.898572+0000","last_unstale":"2022-05-02T09:39:27.571581+0000","last_undegraded":"2022-05-02T09:39:27.571581+0000","last_fullsized":"2022-05-02T09:39:27.571581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778616+0000","last_change":"2022-05-02T09:39:11.369028+0000","last_active":"2022-05-02T09:39:28.778616+0000","last_peered":"2022-05-02T09:39:28.778616+0000","last_clean":"2022-05-02T09:39:28.778616+0000","last_became_active":"2022-05-02T09:39:11.368615+0000","last_became_peered":"2022-05-02T09:39:11.368615+0000","last_unstale":"2022-05-02T09:39:28.778616+0000","last_undegraded":"2022-05-02T09:39:28.778616+0000","last_fullsized":"2022-05-02T09:39:28.778616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568974+0000","last_change":"2022-05-02T09:39:10.902100+0000","last_active":"2022-05-02T09:39:27.568974+0000","last_peered":"2022-05-02T09:39:27.568974+0000","last_clean":"2022-05-02T09:39:27.568974+0000","last_became_active":"2022-05-02T09:39:10.901751+0000","last_became_peered":"2022-05-02T09:39:10.901751+0000","last_unstale":"2022-05-02T09:39:27.568974+0000","last_undegraded":"2022-05-02T09:39:27.568974+0000","last_fullsized":"2022-05-02T09:39:27.568974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570863+0000","last_change":"2022-05-02T09:39:11.368509+0000","last_active":"2022-05-02T09:39:27.570863+0000","last_peered":"2022-05-02T09:39:27.570863+0000","last_clean":"2022-05-02T09:39:27.570863+0000","last_became_active":"2022-05-02T09:39:11.368131+0000","last_became_peered":"2022-05-02T09:39:11.368131+0000","last_unstale":"2022-05-02T09:39:27.570863+0000","last_undegraded":"2022-05-02T09:39:27.570863+0000","last_fullsized":"2022-05-02T09:39:27.570863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:40:00.831109+0000","last_change":"2022-05-02T09:39:10.904582+0000","last_active":"2022-05-02T09:40:00.831109+0000","last_peered":"2022-05-02T09:40:00.831109+0000","last_clean":"2022-05-02T09:40:00.831109+0000","last_became_active":"2022-05-02T09:39:10.904176+0000","last_became_peered":"2022-05-02T09:39:10.904176+0000","last_unstale":"2022-05-02T09:40:00.831109+0000","last_undegraded":"2022-05-02T09:40:00.831109+0000","last_fullsized":"2022-05-02T09:40:00.831109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568989+0000","last_change":"2022-05-02T09:39:11.335492+0000","last_active":"2022-05-02T09:39:27.568989+0000","last_peered":"2022-05-02T09:39:27.568989+0000","last_clean":"2022-05-02T09:39:27.568989+0000","last_became_active":"2022-05-02T09:39:11.335130+0000","last_became_peered":"2022-05-02T09:39:11.335130+0000","last_unstale":"2022-05-02T09:39:27.568989+0000","last_undegraded":"2022-05-02T09:39:27.568989+0000","last_fullsized":"2022-05-02T09:39:27.568989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778064+0000","last_change":"2022-05-02T09:39:10.903440+0000","last_active":"2022-05-02T09:39:28.778064+0000","last_peered":"2022-05-02T09:39:28.778064+0000","last_clean":"2022-05-02T09:39:28.778064+0000","last_became_active":"2022-05-02T09:39:10.903118+0000","last_became_peered":"2022-05-02T09:39:10.903118+0000","last_unstale":"2022-05-02T09:39:28.778064+0000","last_undegraded":"2022-05-02T09:39:28.778064+0000","last_fullsized":"2022-05-02T09:39:28.778064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569754+0000","last_change":"2022-05-02T09:39:11.352433+0000","last_active":"2022-05-02T09:39:27.569754+0000","last_peered":"2022-05-02T09:39:27.569754+0000","last_clean":"2022-05-02T09:39:27.569754+0000","last_became_active":"2022-05-02T09:39:11.351184+0000","last_became_peered":"2022-05-02T09:39:11.351184+0000","last_unstale":"2022-05-02T09:39:27.569754+0000","last_undegraded":"2022-05-02T09:39:27.569754+0000","last_fullsized":"2022-05-02T09:39:27.569754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777990+0000","last_change":"2022-05-02T09:39:10.900964+0000","last_active":"2022-05-02T09:39:28.777990+0000","last_peered":"2022-05-02T09:39:28.777990+0000","last_clean":"2022-05-02T09:39:28.777990+0000","last_became_active":"2022-05-02T09:39:10.900530+0000","last_became_peered":"2022-05-02T09:39:10.900530+0000","last_unstale":"2022-05-02T09:39:28.777990+0000","last_undegraded":"2022-05-02T09:39:28.777990+0000","last_fullsized":"2022-05-02T09:39:28.777990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572595+0000","last_change":"2022-05-02T09:39:11.351647+0000","last_active":"2022-05-02T09:39:27.572595+0000","last_peered":"2022-05-02T09:39:27.572595+0000","last_clean":"2022-05-02T09:39:27.572595+0000","last_became_active":"2022-05-02T09:39:11.349656+0000","last_became_peered":"2022-05-02T09:39:11.349656+0000","last_unstale":"2022-05-02T09:39:27.572595+0000","last_undegraded":"2022-05-02T09:39:27.572595+0000","last_fullsized":"2022-05-02T09:39:27.572595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'16","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2022-05-02T09:41:51.695304+0000","last_change":"2022-05-02T09:39:10.910333+0000","last_active":"2022-05-02T09:41:51.695304+0000","last_peered":"2022-05-02T09:41:51.695304+0000","last_clean":"2022-05-02T09:41:51.695304+0000","last_became_active":"2022-05-02T09:39:10.909972+0000","last_became_peered":"2022-05-02T09:39:10.909972+0000","last_unstale":"2022-05-02T09:41:51.695304+0000","last_undegraded":"2022-05-02T09:41:51.695304+0000","last_fullsized":"2022-05-02T09:41:51.695304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4741,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777976+0000","last_change":"2022-05-02T09:39:11.338449+0000","last_active":"2022-05-02T09:39:28.777976+0000","last_peered":"2022-05-02T09:39:28.777976+0000","last_clean":"2022-05-02T09:39:28.777976+0000","last_became_active":"2022-05-02T09:39:11.337605+0000","last_became_peered":"2022-05-02T09:39:11.337605+0000","last_unstale":"2022-05-02T09:39:28.777976+0000","last_undegraded":"2022-05-02T09:39:28.777976+0000","last_fullsized":"2022-05-02T09:39:28.777976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569987+0000","last_change":"2022-05-02T09:39:10.905320+0000","last_active":"2022-05-02T09:39:27.569987+0000","last_peered":"2022-05-02T09:39:27.569987+0000","last_clean":"2022-05-02T09:39:27.569987+0000","last_became_active":"2022-05-02T09:39:10.904628+0000","last_became_peered":"2022-05-02T09:39:10.904628+0000","last_unstale":"2022-05-02T09:39:27.569987+0000","last_undegraded":"2022-05-02T09:39:27.569987+0000","last_fullsized":"2022-05-02T09:39:27.569987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570645+0000","last_change":"2022-05-02T09:39:11.369158+0000","last_active":"2022-05-02T09:39:27.570645+0000","last_peered":"2022-05-02T09:39:27.570645+0000","last_clean":"2022-05-02T09:39:27.570645+0000","last_became_active":"2022-05-02T09:39:11.368833+0000","last_became_peered":"2022-05-02T09:39:11.368833+0000","last_unstale":"2022-05-02T09:39:27.570645+0000","last_undegraded":"2022-05-02T09:39:27.570645+0000","last_fullsized":"2022-05-02T09:39:27.570645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777165+0000","last_change":"2022-05-02T09:39:10.902612+0000","last_active":"2022-05-02T09:39:28.777165+0000","last_peered":"2022-05-02T09:39:28.777165+0000","last_clean":"2022-05-02T09:39:28.777165+0000","last_became_active":"2022-05-02T09:39:10.902378+0000","last_became_peered":"2022-05-02T09:39:10.902378+0000","last_unstale":"2022-05-02T09:39:28.777165+0000","last_undegraded":"2022-05-02T09:39:28.777165+0000","last_fullsized":"2022-05-02T09:39:28.777165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570529+0000","last_change":"2022-05-02T09:39:11.354510+0000","last_active":"2022-05-02T09:39:27.570529+0000","last_peered":"2022-05-02T09:39:27.570529+0000","last_clean":"2022-05-02T09:39:27.570529+0000","last_became_active":"2022-05-02T09:39:11.354187+0000","last_became_peered":"2022-05-02T09:39:11.354187+0000","last_unstale":"2022-05-02T09:39:27.570529+0000","last_undegraded":"2022-05-02T09:39:27.570529+0000","last_fullsized":"2022-05-02T09:39:27.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569510+0000","last_change":"2022-05-02T09:39:10.910521+0000","last_active":"2022-05-02T09:39:27.569510+0000","last_peered":"2022-05-02T09:39:27.569510+0000","last_clean":"2022-05-02T09:39:27.569510+0000","last_became_active":"2022-05-02T09:39:10.909932+0000","last_became_peered":"2022-05-02T09:39:10.909932+0000","last_unstale":"2022-05-02T09:39:27.569510+0000","last_undegraded":"2022-05-02T09:39:27.569510+0000","last_fullsized":"2022-05-02T09:39:27.569510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778691+0000","last_change":"2022-05-02T09:39:11.349143+0000","last_active":"2022-05-02T09:39:28.778691+0000","last_peered":"2022-05-02T09:39:28.778691+0000","last_clean":"2022-05-02T09:39:28.778691+0000","last_became_active":"2022-05-02T09:39:11.348764+0000","last_became_peered":"2022-05-02T09:39:11.348764+0000","last_unstale":"2022-05-02T09:39:28.778691+0000","last_undegraded":"2022-05-02T09:39:28.778691+0000","last_fullsized":"2022-05-02T09:39:28.778691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572241+0000","last_change":"2022-05-02T09:39:10.892164+0000","last_active":"2022-05-02T09:39:27.572241+0000","last_peered":"2022-05-02T09:39:27.572241+0000","last_clean":"2022-05-02T09:39:27.572241+0000","last_became_active":"2022-05-02T09:39:10.891782+0000","last_became_peered":"2022-05-02T09:39:10.891782+0000","last_unstale":"2022-05-02T09:39:27.572241+0000","last_undegraded":"2022-05-02T09:39:27.572241+0000","last_fullsized":"2022-05-02T09:39:27.572241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570802+0000","last_change":"2022-05-02T09:39:11.368314+0000","last_active":"2022-05-02T09:39:27.570802+0000","last_peered":"2022-05-02T09:39:27.570802+0000","last_clean":"2022-05-02T09:39:27.570802+0000","last_became_active":"2022-05-02T09:39:11.367895+0000","last_became_peered":"2022-05-02T09:39:11.367895+0000","last_unstale":"2022-05-02T09:39:27.570802+0000","last_undegraded":"2022-05-02T09:39:27.570802+0000","last_fullsized":"2022-05-02T09:39:27.570802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777341+0000","last_change":"2022-05-02T09:39:10.901575+0000","last_active":"2022-05-02T09:39:28.777341+0000","last_peered":"2022-05-02T09:39:28.777341+0000","last_clean":"2022-05-02T09:39:28.777341+0000","last_became_active":"2022-05-02T09:39:10.900762+0000","last_became_peered":"2022-05-02T09:39:10.900762+0000","last_unstale":"2022-05-02T09:39:28.777341+0000","last_undegraded":"2022-05-02T09:39:28.777341+0000","last_fullsized":"2022-05-02T09:39:28.777341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569129+0000","last_change":"2022-05-02T09:39:11.361305+0000","last_active":"2022-05-02T09:39:27.569129+0000","last_peered":"2022-05-02T09:39:27.569129+0000","last_clean":"2022-05-02T09:39:27.569129+0000","last_became_active":"2022-05-02T09:39:11.360897+0000","last_became_peered":"2022-05-02T09:39:11.360897+0000","last_unstale":"2022-05-02T09:39:27.569129+0000","last_undegraded":"2022-05-02T09:39:27.569129+0000","last_fullsized":"2022-05-02T09:39:27.569129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778190+0000","last_change":"2022-05-02T09:39:10.894338+0000","last_active":"2022-05-02T09:39:28.778190+0000","last_peered":"2022-05-02T09:39:28.778190+0000","last_clean":"2022-05-02T09:39:28.778190+0000","last_became_active":"2022-05-02T09:39:10.893470+0000","last_became_peered":"2022-05-02T09:39:10.893470+0000","last_unstale":"2022-05-02T09:39:28.778190+0000","last_undegraded":"2022-05-02T09:39:28.778190+0000","last_fullsized":"2022-05-02T09:39:28.778190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571631+0000","last_change":"2022-05-02T09:39:11.341190+0000","last_active":"2022-05-02T09:39:27.571631+0000","last_peered":"2022-05-02T09:39:27.571631+0000","last_clean":"2022-05-02T09:39:27.571631+0000","last_became_active":"2022-05-02T09:39:11.340831+0000","last_became_peered":"2022-05-02T09:39:11.340831+0000","last_unstale":"2022-05-02T09:39:27.571631+0000","last_undegraded":"2022-05-02T09:39:27.571631+0000","last_fullsized":"2022-05-02T09:39:27.571631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570662+0000","last_change":"2022-05-02T09:39:10.907688+0000","last_active":"2022-05-02T09:39:27.570662+0000","last_peered":"2022-05-02T09:39:27.570662+0000","last_clean":"2022-05-02T09:39:27.570662+0000","last_became_active":"2022-05-02T09:39:10.907315+0000","last_became_peered":"2022-05-02T09:39:10.907315+0000","last_unstale":"2022-05-02T09:39:27.570662+0000","last_undegraded":"2022-05-02T09:39:27.570662+0000","last_fullsized":"2022-05-02T09:39:27.570662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777441+0000","last_change":"2022-05-02T09:39:11.338828+0000","last_active":"2022-05-02T09:39:28.777441+0000","last_peered":"2022-05-02T09:39:28.777441+0000","last_clean":"2022-05-02T09:39:28.777441+0000","last_became_active":"2022-05-02T09:39:11.338301+0000","last_became_peered":"2022-05-02T09:39:11.338301+0000","last_unstale":"2022-05-02T09:39:28.777441+0000","last_undegraded":"2022-05-02T09:39:28.777441+0000","last_fullsized":"2022-05-02T09:39:28.777441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777581+0000","last_change":"2022-05-02T09:39:10.900729+0000","last_active":"2022-05-02T09:39:28.777581+0000","last_peered":"2022-05-02T09:39:28.777581+0000","last_clean":"2022-05-02T09:39:28.777581+0000","last_became_active":"2022-05-02T09:39:10.900296+0000","last_became_peered":"2022-05-02T09:39:10.900296+0000","last_unstale":"2022-05-02T09:39:28.777581+0000","last_undegraded":"2022-05-02T09:39:28.777581+0000","last_fullsized":"2022-05-02T09:39:28.777581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777856+0000","last_change":"2022-05-02T09:39:11.362776+0000","last_active":"2022-05-02T09:39:28.777856+0000","last_peered":"2022-05-02T09:39:28.777856+0000","last_clean":"2022-05-02T09:39:28.777856+0000","last_became_active":"2022-05-02T09:39:11.362410+0000","last_became_peered":"2022-05-02T09:39:11.362410+0000","last_unstale":"2022-05-02T09:39:28.777856+0000","last_undegraded":"2022-05-02T09:39:28.777856+0000","last_fullsized":"2022-05-02T09:39:28.777856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569844+0000","last_change":"2022-05-02T09:39:10.905446+0000","last_active":"2022-05-02T09:39:27.569844+0000","last_peered":"2022-05-02T09:39:27.569844+0000","last_clean":"2022-05-02T09:39:27.569844+0000","last_became_active":"2022-05-02T09:39:10.905101+0000","last_became_peered":"2022-05-02T09:39:10.905101+0000","last_unstale":"2022-05-02T09:39:27.569844+0000","last_undegraded":"2022-05-02T09:39:27.569844+0000","last_fullsized":"2022-05-02T09:39:27.569844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777472+0000","last_change":"2022-05-02T09:39:11.341958+0000","last_active":"2022-05-02T09:39:28.777472+0000","last_peered":"2022-05-02T09:39:28.777472+0000","last_clean":"2022-05-02T09:39:28.777472+0000","last_became_active":"2022-05-02T09:39:11.341552+0000","last_became_peered":"2022-05-02T09:39:11.341552+0000","last_unstale":"2022-05-02T09:39:28.777472+0000","last_undegraded":"2022-05-02T09:39:28.777472+0000","last_fullsized":"2022-05-02T09:39:28.777472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:50.828629+0000","last_change":"2022-05-02T09:39:10.909527+0000","last_active":"2022-05-02T09:39:50.828629+0000","last_peered":"2022-05-02T09:39:50.828629+0000","last_clean":"2022-05-02T09:39:50.828629+0000","last_became_active":"2022-05-02T09:39:10.909133+0000","last_became_peered":"2022-05-02T09:39:10.909133+0000","last_unstale":"2022-05-02T09:39:50.828629+0000","last_undegraded":"2022-05-02T09:39:50.828629+0000","last_fullsized":"2022-05-02T09:39:50.828629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570644+0000","last_change":"2022-05-02T09:39:11.372440+0000","last_active":"2022-05-02T09:39:27.570644+0000","last_peered":"2022-05-02T09:39:27.570644+0000","last_clean":"2022-05-02T09:39:27.570644+0000","last_became_active":"2022-05-02T09:39:11.369739+0000","last_became_peered":"2022-05-02T09:39:11.369739+0000","last_unstale":"2022-05-02T09:39:27.570644+0000","last_undegraded":"2022-05-02T09:39:27.570644+0000","last_fullsized":"2022-05-02T09:39:27.570644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569232+0000","last_change":"2022-05-02T09:39:10.910296+0000","last_active":"2022-05-02T09:39:27.569232+0000","last_peered":"2022-05-02T09:39:27.569232+0000","last_clean":"2022-05-02T09:39:27.569232+0000","last_became_active":"2022-05-02T09:39:10.909442+0000","last_became_peered":"2022-05-02T09:39:10.909442+0000","last_unstale":"2022-05-02T09:39:27.569232+0000","last_undegraded":"2022-05-02T09:39:27.569232+0000","last_fullsized":"2022-05-02T09:39:27.569232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778320+0000","last_change":"2022-05-02T09:39:11.337603+0000","last_active":"2022-05-02T09:39:28.778320+0000","last_peered":"2022-05-02T09:39:28.778320+0000","last_clean":"2022-05-02T09:39:28.778320+0000","last_became_active":"2022-05-02T09:39:11.337020+0000","last_became_peered":"2022-05-02T09:39:11.337020+0000","last_unstale":"2022-05-02T09:39:28.778320+0000","last_undegraded":"2022-05-02T09:39:28.778320+0000","last_fullsized":"2022-05-02T09:39:28.778320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568705+0000","last_change":"2022-05-02T09:39:10.898788+0000","last_active":"2022-05-02T09:39:27.568705+0000","last_peered":"2022-05-02T09:39:27.568705+0000","last_clean":"2022-05-02T09:39:27.568705+0000","last_became_active":"2022-05-02T09:39:10.898394+0000","last_became_peered":"2022-05-02T09:39:10.898394+0000","last_unstale":"2022-05-02T09:39:27.568705+0000","last_undegraded":"2022-05-02T09:39:27.568705+0000","last_fullsized":"2022-05-02T09:39:27.568705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571785+0000","last_change":"2022-05-02T09:39:11.342740+0000","last_active":"2022-05-02T09:39:27.571785+0000","last_peered":"2022-05-02T09:39:27.571785+0000","last_clean":"2022-05-02T09:39:27.571785+0000","last_became_active":"2022-05-02T09:39:11.342082+0000","last_became_peered":"2022-05-02T09:39:11.342082+0000","last_unstale":"2022-05-02T09:39:27.571785+0000","last_undegraded":"2022-05-02T09:39:27.571785+0000","last_fullsized":"2022-05-02T09:39:27.571785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572286+0000","last_change":"2022-05-02T09:39:01.565180+0000","last_active":"2022-05-02T09:39:27.572286+0000","last_peered":"2022-05-02T09:39:27.572286+0000","last_clean":"2022-05-02T09:39:27.572286+0000","last_became_active":"2022-05-02T09:39:01.564776+0000","last_became_peered":"2022-05-02T09:39:01.564776+0000","last_unstale":"2022-05-02T09:39:27.572286+0000","last_undegraded":"2022-05-02T09:39:27.572286+0000","last_fullsized":"2022-05-02T09:39:27.572286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778035+0000","last_change":"2022-05-02T09:39:10.902738+0000","last_active":"2022-05-02T09:39:28.778035+0000","last_peered":"2022-05-02T09:39:28.778035+0000","last_clean":"2022-05-02T09:39:28.778035+0000","last_became_active":"2022-05-02T09:39:10.902375+0000","last_became_peered":"2022-05-02T09:39:10.902375+0000","last_unstale":"2022-05-02T09:39:28.778035+0000","last_undegraded":"2022-05-02T09:39:28.778035+0000","last_fullsized":"2022-05-02T09:39:28.778035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571464+0000","last_change":"2022-05-02T09:39:11.350640+0000","last_active":"2022-05-02T09:39:27.571464+0000","last_peered":"2022-05-02T09:39:27.571464+0000","last_clean":"2022-05-02T09:39:27.571464+0000","last_became_active":"2022-05-02T09:39:11.349982+0000","last_became_peered":"2022-05-02T09:39:11.349982+0000","last_unstale":"2022-05-02T09:39:27.571464+0000","last_undegraded":"2022-05-02T09:39:27.571464+0000","last_fullsized":"2022-05-02T09:39:27.571464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569593+0000","last_change":"2022-05-02T09:39:00.589906+0000","last_active":"2022-05-02T09:39:27.569593+0000","last_peered":"2022-05-02T09:39:27.569593+0000","last_clean":"2022-05-02T09:39:27.569593+0000","last_became_active":"2022-05-02T09:39:00.589430+0000","last_became_peered":"2022-05-02T09:39:00.589430+0000","last_unstale":"2022-05-02T09:39:27.569593+0000","last_undegraded":"2022-05-02T09:39:27.569593+0000","last_fullsized":"2022-05-02T09:39:27.569593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:55.828597+0000","last_change":"2022-05-02T09:39:10.892859+0000","last_active":"2022-05-02T09:39:55.828597+0000","last_peered":"2022-05-02T09:39:55.828597+0000","last_clean":"2022-05-02T09:39:55.828597+0000","last_became_active":"2022-05-02T09:39:10.892472+0000","last_became_peered":"2022-05-02T09:39:10.892472+0000","last_unstale":"2022-05-02T09:39:55.828597+0000","last_undegraded":"2022-05-02T09:39:55.828597+0000","last_fullsized":"2022-05-02T09:39:55.828597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571888+0000","last_change":"2022-05-02T09:39:11.342628+0000","last_active":"2022-05-02T09:39:27.571888+0000","last_peered":"2022-05-02T09:39:27.571888+0000","last_clean":"2022-05-02T09:39:27.571888+0000","last_became_active":"2022-05-02T09:39:11.342300+0000","last_became_peered":"2022-05-02T09:39:11.342300+0000","last_unstale":"2022-05-02T09:39:27.571888+0000","last_undegraded":"2022-05-02T09:39:27.571888+0000","last_fullsized":"2022-05-02T09:39:27.571888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777603+0000","last_change":"2022-05-02T09:39:00.590616+0000","last_active":"2022-05-02T09:39:28.777603+0000","last_peered":"2022-05-02T09:39:28.777603+0000","last_clean":"2022-05-02T09:39:28.777603+0000","last_became_active":"2022-05-02T09:39:00.590188+0000","last_became_peered":"2022-05-02T09:39:00.590188+0000","last_unstale":"2022-05-02T09:39:28.777603+0000","last_undegraded":"2022-05-02T09:39:28.777603+0000","last_fullsized":"2022-05-02T09:39:28.777603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572071+0000","last_change":"2022-05-02T09:39:10.892845+0000","last_active":"2022-05-02T09:39:27.572071+0000","last_peered":"2022-05-02T09:39:27.572071+0000","last_clean":"2022-05-02T09:39:27.572071+0000","last_became_active":"2022-05-02T09:39:10.892469+0000","last_became_peered":"2022-05-02T09:39:10.892469+0000","last_unstale":"2022-05-02T09:39:27.572071+0000","last_undegraded":"2022-05-02T09:39:27.572071+0000","last_fullsized":"2022-05-02T09:39:27.572071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571927+0000","last_change":"2022-05-02T09:39:11.355880+0000","last_active":"2022-05-02T09:39:27.571927+0000","last_peered":"2022-05-02T09:39:27.571927+0000","last_clean":"2022-05-02T09:39:27.571927+0000","last_became_active":"2022-05-02T09:39:11.355457+0000","last_became_peered":"2022-05-02T09:39:11.355457+0000","last_unstale":"2022-05-02T09:39:27.571927+0000","last_undegraded":"2022-05-02T09:39:27.571927+0000","last_fullsized":"2022-05-02T09:39:27.571927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570469+0000","last_change":"2022-05-02T09:39:00.590210+0000","last_active":"2022-05-02T09:39:27.570469+0000","last_peered":"2022-05-02T09:39:27.570469+0000","last_clean":"2022-05-02T09:39:27.570469+0000","last_became_active":"2022-05-02T09:39:00.589802+0000","last_became_peered":"2022-05-02T09:39:00.589802+0000","last_unstale":"2022-05-02T09:39:27.570469+0000","last_undegraded":"2022-05-02T09:39:27.570469+0000","last_fullsized":"2022-05-02T09:39:27.570469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571868+0000","last_change":"2022-05-02T09:38:56.645492+0000","last_active":"2022-05-02T09:39:27.571868+0000","last_peered":"2022-05-02T09:39:27.571868+0000","last_clean":"2022-05-02T09:39:27.571868+0000","last_became_active":"2022-05-02T09:38:56.645040+0000","last_became_peered":"2022-05-02T09:38:56.645040+0000","last_unstale":"2022-05-02T09:39:27.571868+0000","last_undegraded":"2022-05-02T09:39:27.571868+0000","last_fullsized":"2022-05-02T09:39:27.571868+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569457+0000","last_change":"2022-05-02T09:39:10.909467+0000","last_active":"2022-05-02T09:39:27.569457+0000","last_peered":"2022-05-02T09:39:27.569457+0000","last_clean":"2022-05-02T09:39:27.569457+0000","last_became_active":"2022-05-02T09:39:10.909095+0000","last_became_peered":"2022-05-02T09:39:10.909095+0000","last_unstale":"2022-05-02T09:39:27.569457+0000","last_undegraded":"2022-05-02T09:39:27.569457+0000","last_fullsized":"2022-05-02T09:39:27.569457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571028+0000","last_change":"2022-05-02T09:39:11.372802+0000","last_active":"2022-05-02T09:39:27.571028+0000","last_peered":"2022-05-02T09:39:27.571028+0000","last_clean":"2022-05-02T09:39:27.571028+0000","last_became_active":"2022-05-02T09:39:11.372411+0000","last_became_peered":"2022-05-02T09:39:11.372411+0000","last_unstale":"2022-05-02T09:39:27.571028+0000","last_undegraded":"2022-05-02T09:39:27.571028+0000","last_fullsized":"2022-05-02T09:39:27.571028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568833+0000","last_change":"2022-05-02T09:39:00.590310+0000","last_active":"2022-05-02T09:39:27.568833+0000","last_peered":"2022-05-02T09:39:27.568833+0000","last_clean":"2022-05-02T09:39:27.568833+0000","last_became_active":"2022-05-02T09:39:00.589116+0000","last_became_peered":"2022-05-02T09:39:00.589116+0000","last_unstale":"2022-05-02T09:39:27.568833+0000","last_undegraded":"2022-05-02T09:39:27.568833+0000","last_fullsized":"2022-05-02T09:39:27.568833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777242+0000","last_change":"2022-05-02T09:39:10.892074+0000","last_active":"2022-05-02T09:39:28.777242+0000","last_peered":"2022-05-02T09:39:28.777242+0000","last_clean":"2022-05-02T09:39:28.777242+0000","last_became_active":"2022-05-02T09:39:10.891638+0000","last_became_peered":"2022-05-02T09:39:10.891638+0000","last_unstale":"2022-05-02T09:39:28.777242+0000","last_undegraded":"2022-05-02T09:39:28.777242+0000","last_fullsized":"2022-05-02T09:39:28.777242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778750+0000","last_change":"2022-05-02T09:39:11.363589+0000","last_active":"2022-05-02T09:39:28.778750+0000","last_peered":"2022-05-02T09:39:28.778750+0000","last_clean":"2022-05-02T09:39:28.778750+0000","last_became_active":"2022-05-02T09:39:11.363222+0000","last_became_peered":"2022-05-02T09:39:11.363222+0000","last_unstale":"2022-05-02T09:39:28.778750+0000","last_undegraded":"2022-05-02T09:39:28.778750+0000","last_fullsized":"2022-05-02T09:39:28.778750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570805+0000","last_change":"2022-05-02T09:39:01.566417+0000","last_active":"2022-05-02T09:39:27.570805+0000","last_peered":"2022-05-02T09:39:27.570805+0000","last_clean":"2022-05-02T09:39:27.570805+0000","last_became_active":"2022-05-02T09:39:01.566030+0000","last_became_peered":"2022-05-02T09:39:01.566030+0000","last_unstale":"2022-05-02T09:39:27.570805+0000","last_undegraded":"2022-05-02T09:39:27.570805+0000","last_fullsized":"2022-05-02T09:39:27.570805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.571763+0000","last_change":"2022-05-02T09:39:10.886028+0000","last_active":"2022-05-02T09:39:27.571763+0000","last_peered":"2022-05-02T09:39:27.571763+0000","last_clean":"2022-05-02T09:39:27.571763+0000","last_became_active":"2022-05-02T09:39:10.885638+0000","last_became_peered":"2022-05-02T09:39:10.885638+0000","last_unstale":"2022-05-02T09:39:27.571763+0000","last_undegraded":"2022-05-02T09:39:27.571763+0000","last_fullsized":"2022-05-02T09:39:27.571763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777799+0000","last_change":"2022-05-02T09:39:11.360434+0000","last_active":"2022-05-02T09:39:28.777799+0000","last_peered":"2022-05-02T09:39:28.777799+0000","last_clean":"2022-05-02T09:39:28.777799+0000","last_became_active":"2022-05-02T09:39:11.360072+0000","last_became_peered":"2022-05-02T09:39:11.360072+0000","last_unstale":"2022-05-02T09:39:28.777799+0000","last_undegraded":"2022-05-02T09:39:28.777799+0000","last_fullsized":"2022-05-02T09:39:28.777799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570643+0000","last_change":"2022-05-02T09:39:10.907656+0000","last_active":"2022-05-02T09:39:27.570643+0000","last_peered":"2022-05-02T09:39:27.570643+0000","last_clean":"2022-05-02T09:39:27.570643+0000","last_became_active":"2022-05-02T09:39:10.907185+0000","last_became_peered":"2022-05-02T09:39:10.907185+0000","last_unstale":"2022-05-02T09:39:27.570643+0000","last_undegraded":"2022-05-02T09:39:27.570643+0000","last_fullsized":"2022-05-02T09:39:27.570643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572355+0000","last_change":"2022-05-02T09:39:01.565214+0000","last_active":"2022-05-02T09:39:27.572355+0000","last_peered":"2022-05-02T09:39:27.572355+0000","last_clean":"2022-05-02T09:39:27.572355+0000","last_became_active":"2022-05-02T09:39:01.564748+0000","last_became_peered":"2022-05-02T09:39:01.564748+0000","last_unstale":"2022-05-02T09:39:27.572355+0000","last_undegraded":"2022-05-02T09:39:27.572355+0000","last_fullsized":"2022-05-02T09:39:27.572355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.568766+0000","last_change":"2022-05-02T09:39:11.368282+0000","last_active":"2022-05-02T09:39:27.568766+0000","last_peered":"2022-05-02T09:39:27.568766+0000","last_clean":"2022-05-02T09:39:27.568766+0000","last_became_active":"2022-05-02T09:39:11.367875+0000","last_became_peered":"2022-05-02T09:39:11.367875+0000","last_unstale":"2022-05-02T09:39:27.568766+0000","last_undegraded":"2022-05-02T09:39:27.568766+0000","last_fullsized":"2022-05-02T09:39:27.568766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570543+0000","last_change":"2022-05-02T09:39:01.566430+0000","last_active":"2022-05-02T09:39:27.570543+0000","last_peered":"2022-05-02T09:39:27.570543+0000","last_clean":"2022-05-02T09:39:27.570543+0000","last_became_active":"2022-05-02T09:39:01.566048+0000","last_became_peered":"2022-05-02T09:39:01.566048+0000","last_unstale":"2022-05-02T09:39:27.570543+0000","last_undegraded":"2022-05-02T09:39:27.570543+0000","last_fullsized":"2022-05-02T09:39:27.570543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:45.831699+0000","last_change":"2022-05-02T09:39:10.900388+0000","last_active":"2022-05-02T09:39:45.831699+0000","last_peered":"2022-05-02T09:39:45.831699+0000","last_clean":"2022-05-02T09:39:45.831699+0000","last_became_active":"2022-05-02T09:39:10.900007+0000","last_became_peered":"2022-05-02T09:39:10.900007+0000","last_unstale":"2022-05-02T09:39:45.831699+0000","last_undegraded":"2022-05-02T09:39:45.831699+0000","last_fullsized":"2022-05-02T09:39:45.831699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777426+0000","last_change":"2022-05-02T09:39:11.337380+0000","last_active":"2022-05-02T09:39:28.777426+0000","last_peered":"2022-05-02T09:39:28.777426+0000","last_clean":"2022-05-02T09:39:28.777426+0000","last_became_active":"2022-05-02T09:39:11.337028+0000","last_became_peered":"2022-05-02T09:39:11.337028+0000","last_unstale":"2022-05-02T09:39:28.777426+0000","last_undegraded":"2022-05-02T09:39:28.777426+0000","last_fullsized":"2022-05-02T09:39:28.777426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"20'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:50.829318+0000","last_change":"2022-05-02T09:39:10.903259+0000","last_active":"2022-05-02T09:39:50.829318+0000","last_peered":"2022-05-02T09:39:50.829318+0000","last_clean":"2022-05-02T09:39:50.829318+0000","last_became_active":"2022-05-02T09:39:10.902918+0000","last_became_peered":"2022-05-02T09:39:10.902918+0000","last_unstale":"2022-05-02T09:39:50.829318+0000","last_undegraded":"2022-05-02T09:39:50.829318+0000","last_fullsized":"2022-05-02T09:39:50.829318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778263+0000","last_change":"2022-05-02T09:39:11.366158+0000","last_active":"2022-05-02T09:39:28.778263+0000","last_peered":"2022-05-02T09:39:28.778263+0000","last_clean":"2022-05-02T09:39:28.778263+0000","last_became_active":"2022-05-02T09:39:11.365798+0000","last_became_peered":"2022-05-02T09:39:11.365798+0000","last_unstale":"2022-05-02T09:39:28.778263+0000","last_undegraded":"2022-05-02T09:39:28.778263+0000","last_fullsized":"2022-05-02T09:39:28.778263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572023+0000","last_change":"2022-05-02T09:39:10.891406+0000","last_active":"2022-05-02T09:39:27.572023+0000","last_peered":"2022-05-02T09:39:27.572023+0000","last_clean":"2022-05-02T09:39:27.572023+0000","last_became_active":"2022-05-02T09:39:10.891066+0000","last_became_peered":"2022-05-02T09:39:10.891066+0000","last_unstale":"2022-05-02T09:39:27.572023+0000","last_undegraded":"2022-05-02T09:39:27.572023+0000","last_fullsized":"2022-05-02T09:39:27.572023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777995+0000","last_change":"2022-05-02T09:39:11.338465+0000","last_active":"2022-05-02T09:39:28.777995+0000","last_peered":"2022-05-02T09:39:28.777995+0000","last_clean":"2022-05-02T09:39:28.777995+0000","last_became_active":"2022-05-02T09:39:11.338071+0000","last_became_peered":"2022-05-02T09:39:11.338071+0000","last_unstale":"2022-05-02T09:39:28.777995+0000","last_undegraded":"2022-05-02T09:39:28.777995+0000","last_fullsized":"2022-05-02T09:39:28.777995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570913+0000","last_change":"2022-05-02T09:39:10.902331+0000","last_active":"2022-05-02T09:39:27.570913+0000","last_peered":"2022-05-02T09:39:27.570913+0000","last_clean":"2022-05-02T09:39:27.570913+0000","last_became_active":"2022-05-02T09:39:10.901872+0000","last_became_peered":"2022-05-02T09:39:10.901872+0000","last_unstale":"2022-05-02T09:39:27.570913+0000","last_undegraded":"2022-05-02T09:39:27.570913+0000","last_fullsized":"2022-05-02T09:39:27.570913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777323+0000","last_change":"2022-05-02T09:39:11.340492+0000","last_active":"2022-05-02T09:39:28.777323+0000","last_peered":"2022-05-02T09:39:28.777323+0000","last_clean":"2022-05-02T09:39:28.777323+0000","last_became_active":"2022-05-02T09:39:11.339170+0000","last_became_peered":"2022-05-02T09:39:11.339170+0000","last_unstale":"2022-05-02T09:39:28.777323+0000","last_undegraded":"2022-05-02T09:39:28.777323+0000","last_fullsized":"2022-05-02T09:39:28.777323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570323+0000","last_change":"2022-05-02T09:39:10.906911+0000","last_active":"2022-05-02T09:39:27.570323+0000","last_peered":"2022-05-02T09:39:27.570323+0000","last_clean":"2022-05-02T09:39:27.570323+0000","last_became_active":"2022-05-02T09:39:10.906571+0000","last_became_peered":"2022-05-02T09:39:10.906571+0000","last_unstale":"2022-05-02T09:39:27.570323+0000","last_undegraded":"2022-05-02T09:39:27.570323+0000","last_fullsized":"2022-05-02T09:39:27.570323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569897+0000","last_change":"2022-05-02T09:39:11.326336+0000","last_active":"2022-05-02T09:39:27.569897+0000","last_peered":"2022-05-02T09:39:27.569897+0000","last_clean":"2022-05-02T09:39:27.569897+0000","last_became_active":"2022-05-02T09:39:11.325987+0000","last_became_peered":"2022-05-02T09:39:11.325987+0000","last_unstale":"2022-05-02T09:39:27.569897+0000","last_undegraded":"2022-05-02T09:39:27.569897+0000","last_fullsized":"2022-05-02T09:39:27.569897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.778245+0000","last_change":"2022-05-02T09:39:10.901800+0000","last_active":"2022-05-02T09:39:28.778245+0000","last_peered":"2022-05-02T09:39:28.778245+0000","last_clean":"2022-05-02T09:39:28.778245+0000","last_became_active":"2022-05-02T09:39:10.901231+0000","last_became_peered":"2022-05-02T09:39:10.901231+0000","last_unstale":"2022-05-02T09:39:28.778245+0000","last_undegraded":"2022-05-02T09:39:28.778245+0000","last_fullsized":"2022-05-02T09:39:28.778245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.776985+0000","last_change":"2022-05-02T09:39:11.366149+0000","last_active":"2022-05-02T09:39:28.776985+0000","last_peered":"2022-05-02T09:39:28.776985+0000","last_clean":"2022-05-02T09:39:28.776985+0000","last_became_active":"2022-05-02T09:39:11.365779+0000","last_became_peered":"2022-05-02T09:39:11.365779+0000","last_unstale":"2022-05-02T09:39:28.776985+0000","last_undegraded":"2022-05-02T09:39:28.776985+0000","last_fullsized":"2022-05-02T09:39:28.776985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572205+0000","last_change":"2022-05-02T09:39:11.337246+0000","last_active":"2022-05-02T09:39:27.572205+0000","last_peered":"2022-05-02T09:39:27.572205+0000","last_clean":"2022-05-02T09:39:27.572205+0000","last_became_active":"2022-05-02T09:39:11.336550+0000","last_became_peered":"2022-05-02T09:39:11.336550+0000","last_unstale":"2022-05-02T09:39:27.572205+0000","last_undegraded":"2022-05-02T09:39:27.572205+0000","last_fullsized":"2022-05-02T09:39:27.572205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.569220+0000","last_change":"2022-05-02T09:39:11.336265+0000","last_active":"2022-05-02T09:39:27.569220+0000","last_peered":"2022-05-02T09:39:27.569220+0000","last_clean":"2022-05-02T09:39:27.569220+0000","last_became_active":"2022-05-02T09:39:11.335902+0000","last_became_peered":"2022-05-02T09:39:11.335902+0000","last_unstale":"2022-05-02T09:39:27.569220+0000","last_undegraded":"2022-05-02T09:39:27.569220+0000","last_fullsized":"2022-05-02T09:39:27.569220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:28.777196+0000","last_change":"2022-05-02T09:39:11.344092+0000","last_active":"2022-05-02T09:39:28.777196+0000","last_peered":"2022-05-02T09:39:28.777196+0000","last_clean":"2022-05-02T09:39:28.777196+0000","last_became_active":"2022-05-02T09:39:11.342274+0000","last_became_peered":"2022-05-02T09:39:11.342274+0000","last_unstale":"2022-05-02T09:39:28.777196+0000","last_undegraded":"2022-05-02T09:39:28.777196+0000","last_fullsized":"2022-05-02T09:39:28.777196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.570112+0000","last_change":"2022-05-02T09:39:11.367441+0000","last_active":"2022-05-02T09:39:27.570112+0000","last_peered":"2022-05-02T09:39:27.570112+0000","last_clean":"2022-05-02T09:39:27.570112+0000","last_became_active":"2022-05-02T09:39:11.366927+0000","last_became_peered":"2022-05-02T09:39:11.366927+0000","last_unstale":"2022-05-02T09:39:27.570112+0000","last_undegraded":"2022-05-02T09:39:27.570112+0000","last_fullsized":"2022-05-02T09:39:27.570112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-05-02T09:39:27.572169+0000","last_change":"2022-05-02T09:39:11.355432+0000","last_active":"2022-05-02T09:39:27.572169+0000","last_peered":"2022-05-02T09:39:27.572169+0000","last_clean":"2022-05-02T09:39:27.572169+0000","last_became_active":"2022-05-02T09:39:11.351852+0000","last_became_peered":"2022-05-02T09:39:11.351852+0000","last_unstale":"2022-05-02T09:39:27.572169+0000","last_undegraded":"2022-05-02T09:39:27.572169+0000","last_fullsized":"2022-05-02T09:39:27.572169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8509,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672996,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":65156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.47499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.371}]},{"osd":1,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.53100000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.60999999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon May 2 09:40:56 2022","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.439,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51800000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672996,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40899999999999997,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.48699999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.50800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.46400000000000002,"15min":0.47899999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61799999999999999,"5min":1.274,"15min":1.274},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.5,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.37},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.57999999999999996,"5min":1.228,"15min":1.228},"last":0.36499999999999999}]}]},{"osd":3,"up_from":10,"seq":42949672996,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":69031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.25},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49399999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31}]},{"osd":1,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42999999999999999,"15min":0.436},"min":{"1min":0.313,"5min":0.309,"15min":0.309},"max":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon May 2 09:40:59 2022","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.53000000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54700000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.34300000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672996,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":64683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63800000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54700000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57999999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.626},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon May 2 09:40:58 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48799999999999999,"15min":0.49399999999999999},"min":{"1min":0.38500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.61099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-02T09:41:55.995 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-05-02T09:41:55.995 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-05-02T09:41:55.995 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-05-02T09:41:55.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-05-02T09:41:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.215+0000 7fcdf45ff700 1 Processor -- start 2022-05-02T09:41:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.215+0000 7fcdf45ff700 1 -- start start 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf45ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf45ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec148a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf45ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0a7c30 con 0x7fcdec13e740 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf45ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0aae20 con 0x7fcdec0a8a50 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf45ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec13e260 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.216+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf239b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcdec13e740 0x7fcdec0702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52370/0 (socket says 172.21.15.50:52370) 2022-05-02T09:41:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf239b700 1 -- 172.21.15.50:0/4268173420 learned_addr learned my addr 172.21.15.50:0/4268173420 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf2b9c700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 msgr2=0x7fcdec148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf1b9a700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/4268173420 >> v1:172.21.15.50:6789/0 conn(0x7fcdec13e740 legacy=0x7fcdec0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf1399700 1 -- 172.21.15.50:0/4268173420 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565316600 0 0) 0x7fcdec0a7c30 con 0x7fcdec13e740 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.217+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/4268173420 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec13e520 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf1b9a700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec146530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009790 tx=0x7fcddc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15136fc709d1bd8 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf1399700 1 -- 172.21.15.50:0/4268173420 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc011630 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf1399700 1 -- 172.21.15.50:0/4268173420 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc011790 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf1399700 1 -- 172.21.15.50:0/4268173420 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc011b30 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 -- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 msgr2=0x7fcdec146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec146530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009790 tx=0x7fcddc009060 comp rx=0 tx=0).stop 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 -- 172.21.15.50:0/4268173420 shutdown_connections 2022-05-02T09:41:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/4268173420 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec146530 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.218+0000 7fcdf45ff700 1 -- 172.21.15.50:0/4268173420 >> 172.21.15.50:0/4268173420 conn(0x7fcdec06b010 msgr2=0x7fcdec067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.219+0000 7fcdf45ff700 1 -- 172.21.15.50:0/4268173420 shutdown_connections 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.219+0000 7fcdf45ff700 1 -- 172.21.15.50:0/4268173420 wait complete. 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.220+0000 7fcdf45ff700 1 Processor -- start 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.220+0000 7fcdf45ff700 1 -- start start 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdec13e740 0x7fcdec13bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec06ccb0 con 0x7fcdec13e740 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec06da90 con 0x7fcdec0a8a50 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf45ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0a5c70 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf2b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdec13e740 0x7fcdec13bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec06d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50652/0 (socket says 172.21.15.50:50652) 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf239b700 1 -- 172.21.15.50:0/292300473 learned_addr learned my addr 172.21.15.50:0/292300473 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.221+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49988/0 (socket says 172.21.15.50:49988) 2022-05-02T09:41:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 msgr2=0x7fcdec06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdec13e740 msgr2=0x7fcdec13bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdec13e740 0x7fcdec13bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 -- 172.21.15.50:0/292300473 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0092a0 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdf1b9a700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcddc016000 tx=0x7fcddc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc004570 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.222+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc000bc0 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.223+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec06e050 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.223+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc025420 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.223+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec06e570 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.224+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec06e760 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.224+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fcddc02c030 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.225+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fcddc05aaa0 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.229+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fcddc007730 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.414+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdec0a7e80 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.415+0000 7fcdda7fc700 1 -- 172.21.15.50:0/292300473 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcddc02a070 con 0x7fcdec0ac0b0 2022-05-02T09:41:56.418 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:56.418 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 >> v1:172.21.15.50:6800/36423 conn(0x7fcdcc044b70 legacy=0x7fcdcc047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 msgr2=0x7fcdec0a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcddc016000 tx=0x7fcddc017000 comp rx=0 tx=0).stop 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 shutdown_connections 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdec13e740 0x7fcdec13bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdec0a8a50 0x7fcdec06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 --2- 172.21.15.50:0/292300473 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcdec0ac0b0 0x7fcdec0a6f10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 >> 172.21.15.50:0/292300473 conn(0x7fcdec06b010 msgr2=0x7fcdec0702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:56.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 shutdown_connections 2022-05-02T09:41:56.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.417+0000 7fcdf45ff700 1 -- 172.21.15.50:0/292300473 wait complete. 2022-05-02T09:41:56.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-05-02T09:41:56.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:41:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.665+0000 7fb212d9d700 1 Processor -- start 2022-05-02T09:41:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.666+0000 7fb212d9d700 1 -- start start 2022-05-02T09:41:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.666+0000 7fb212d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c0ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.666+0000 7fb212d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb212d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0aba90 con 0x7fb20c13eea0 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb212d9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1406c0 con 0x7fb20c0a8700 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb212d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c140960 con 0x7fb20c0702f0 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb21159a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb211d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c0ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb21159a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50654/0 (socket says 172.21.15.50:50654) 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb21159a700 1 -- 172.21.15.50:0/4099707394 learned_addr learned my addr 172.21.15.50:0/4099707394 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb211d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c0ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49990/0 (socket says 172.21.15.50:49990) 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.667+0000 7fb21259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb20c13eea0 0x7fb20c13f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52372/0 (socket says 172.21.15.50:52372) 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb21159a700 1 -- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 msgr2=0x7fb20c0ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb21159a700 1 --2- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c0ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb21159a700 1 -- 172.21.15.50:0/4099707394 >> v1:172.21.15.50:6789/0 conn(0x7fb20c13eea0 legacy=0x7fb20c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb21159a700 1 -- 172.21.15.50:0/4099707394 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0abed0 con 0x7fb20c0a8700 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb21159a700 1 --2- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009830 tx=0x7fb1fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f9a6ebb8950538b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb210d99700 1 -- 172.21.15.50:0/4099707394 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc004030 con 0x7fb20c0a8700 2022-05-02T09:41:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb210d99700 1 -- 172.21.15.50:0/4099707394 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc004190 con 0x7fb20c0a8700 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.668+0000 7fb210d99700 1 -- 172.21.15.50:0/4099707394 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc011630 con 0x7fb20c0a8700 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 -- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 msgr2=0x7fb20c0ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 --2- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009830 tx=0x7fb1fc0090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 -- 172.21.15.50:0/4099707394 shutdown_connections 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 --2- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c0ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 --2- 172.21.15.50:0/4099707394 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c0a8700 0x7fb20c0ad530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 -- 172.21.15.50:0/4099707394 >> 172.21.15.50:0/4099707394 conn(0x7fb20c0698f0 msgr2=0x7fb20c067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:56.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 -- 172.21.15.50:0/4099707394 shutdown_connections 2022-05-02T09:41:56.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.669+0000 7fb212d9d700 1 -- 172.21.15.50:0/4099707394 wait complete. 2022-05-02T09:41:56.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.670+0000 7fb212d9d700 1 Processor -- start 2022-05-02T09:41:56.677 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 -- start start 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c0a8700 0x7fb20c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 0x7fb20c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c09b8c0 con 0x7fb20c0a8700 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c09c300 con 0x7fb20c13eea0 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.671+0000 7fb212d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c14b500 con 0x7fb20c0702f0 2022-05-02T09:41:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb21259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 0x7fb20c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb21159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c0a8700 0x7fb20c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49992/0 (socket says 172.21.15.50:49992) 2022-05-02T09:41:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 -- 172.21.15.50:0/2751927644 learned_addr learned my addr 172.21.15.50:0/2751927644 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 -- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 msgr2=0x7fb20c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 0x7fb20c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 -- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c0a8700 msgr2=0x7fb20c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c0a8700 0x7fb20c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.680 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb211d9b700 1 -- 172.21.15.50:0/2751927644 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009370 con 0x7fb20c0702f0 2022-05-02T09:41:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.672+0000 7fb21259c700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 0x7fb20c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb211d9b700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb20800e930 tx=0x7fb208009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208013680 con 0x7fb20c0702f0 2022-05-02T09:41:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2080137e0 con 0x7fb20c0702f0 2022-05-02T09:41:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208013b60 con 0x7fb20c0702f0 2022-05-02T09:41:56.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c09ae20 con 0x7fb20c0702f0 2022-05-02T09:41:56.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.673+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c0a5d70 con 0x7fb20c0702f0 2022-05-02T09:41:56.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.674+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c068820 con 0x7fb20c0702f0 2022-05-02T09:41:56.682 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.675+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fb208019030 con 0x7fb20c0702f0 2022-05-02T09:41:56.683 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.675+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fb208059790 con 0x7fb20c0702f0 2022-05-02T09:41:56.683 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.679+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fb208038610 con 0x7fb20c0702f0 2022-05-02T09:41:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.836+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb20c0a8c40 con 0x7fb20c0702f0 2022-05-02T09:41:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.837+0000 7fb1f9ffb700 1 -- 172.21.15.50:0/2751927644 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11531 (secure 0 0 0) 0x7fb20803be00 con 0x7fb20c0702f0 2022-05-02T09:41:56.840 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:56.840 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:41:53.572908+0000","last_up_change":"2022-05-02T09:38:55.533250+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 >> v1:172.21.15.50:6800/36423 conn(0x7fb1ec044b40 legacy=0x7fb1ec046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 msgr2=0x7fb20c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb20800e930 tx=0x7fb208009060 comp rx=0 tx=0).stop 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 shutdown_connections 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fb20c0702f0 0x7fb20c06dd10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb20c13eea0 0x7fb20c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 --2- 172.21.15.50:0/2751927644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c0a8700 0x7fb20c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 >> 172.21.15.50:0/2751927644 conn(0x7fb20c0698f0 msgr2=0x7fb20c0ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 shutdown_connections 2022-05-02T09:41:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:56.839+0000 7fb212d9d700 1 -- 172.21.15.50:0/2751927644 wait complete. 2022-05-02T09:41:56.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-05-02T09:39:08.938842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-05-02T09:39:10.323546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-05-02T09:41:56.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-05-02T09:41:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.088+0000 7fa85a3ff700 1 Processor -- start 2022-05-02T09:41:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.089+0000 7fa85a3ff700 1 -- start start 2022-05-02T09:41:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.089+0000 7fa85a3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa85a3ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 0x7fa8541416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa85a3ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540a9310 con 0x7fa85413e790 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa85a3ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540a90a0 con 0x7fa85413dfe0 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa85a3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540a7fe0 con 0x7fa8540a9830 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa853fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa853fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50658/0 (socket says 172.21.15.50:50658) 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa8537fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa85413e790 0x7fa854140fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52374/0 (socket says 172.21.15.50:52374) 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa853fff700 1 -- 172.21.15.50:0/3931249550 learned_addr learned my addr 172.21.15.50:0/3931249550 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.090+0000 7fa85899c700 1 --2- 172.21.15.50:0/3931249550 >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 0x7fa8541416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa853fff700 1 -- 172.21.15.50:0/3931249550 >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 msgr2=0x7fa8541416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa853fff700 1 --2- 172.21.15.50:0/3931249550 >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 0x7fa8541416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa853fff700 1 -- 172.21.15.50:0/3931249550 >> v1:172.21.15.50:6789/0 conn(0x7fa85413e790 legacy=0x7fa854140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa853fff700 1 -- 172.21.15.50:0/3931249550 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540a8280 con 0x7fa8540a9830 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa85899c700 1 --2- 172.21.15.50:0/3931249550 >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 0x7fa8541416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa853fff700 1 --2- 172.21.15.50:0/3931249550 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa844006fd0 tx=0x7fa8440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff3c84b1bf6fb2a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa852ffd700 1 -- 172.21.15.50:0/3931249550 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844004030 con 0x7fa8540a9830 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa852ffd700 1 -- 172.21.15.50:0/3931249550 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8440041b0 con 0x7fa8540a9830 2022-05-02T09:41:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.091+0000 7fa852ffd700 1 -- 172.21.15.50:0/3931249550 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844011630 con 0x7fa8540a9830 2022-05-02T09:41:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 -- 172.21.15.50:0/3931249550 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 msgr2=0x7fa8540a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/3931249550 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa844006fd0 tx=0x7fa8440090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 -- 172.21.15.50:0/3931249550 shutdown_connections 2022-05-02T09:41:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/3931249550 >> v2:172.21.15.50:3300/0 conn(0x7fa85413dfe0 0x7fa8541416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/3931249550 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8540a9830 0x7fa8540a5800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 -- 172.21.15.50:0/3931249550 >> 172.21.15.50:0/3931249550 conn(0x7fa854062df0 msgr2=0x7fa8540631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 -- 172.21.15.50:0/3931249550 shutdown_connections 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.092+0000 7fa85a3ff700 1 -- 172.21.15.50:0/3931249550 wait complete. 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.094+0000 7fa85a3ff700 1 Processor -- start 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.094+0000 7fa85a3ff700 1 -- start start 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 0x7fa8540aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa85413e790 0x7fa8540aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540ac940 con 0x7fa8540a9830 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540acc00 con 0x7fa85413e790 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85a3ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa854141b00 con 0x7fa85413dfe0 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa8537fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 0x7fa8540aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36110/0 (socket says 172.21.15.50:36110) 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 -- 172.21.15.50:0/597762549 learned_addr learned my addr 172.21.15.50:0/597762549 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa8537fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 0x7fa8540aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49994/0 (socket says 172.21.15.50:49994) 2022-05-02T09:41:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa85899c700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa85413e790 0x7fa8540aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 -- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 msgr2=0x7fa8540aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 0x7fa8540aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 -- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa85413e790 msgr2=0x7fa8540aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.095+0000 7fa853fff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa85413e790 0x7fa8540aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa853fff700 1 -- 172.21.15.50:0/597762549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c009a20 con 0x7fa8540a9830 2022-05-02T09:41:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa853fff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa844004000 tx=0x7fa844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440034e0 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844003640 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844009370 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844003a00 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.096+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8540ac4b0 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.098+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8540ac6a0 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.098+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fa84402b030 con 0x7fa8540a9830 2022-05-02T09:41:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.098+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa84405b100 con 0x7fa8540a9830 2022-05-02T09:41:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.102+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fa844026590 con 0x7fa8540a9830 2022-05-02T09:41:57.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.258+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa85404bfb0 con 0x7fa8540a9830 2022-05-02T09:41:57.262 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.259+0000 7fa83bfff700 1 -- 172.21.15.50:0/597762549 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa844029030 con 0x7fa8540a9830 2022-05-02T09:41:57.262 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 >> v1:172.21.15.50:6800/36423 conn(0x7fa834044b40 legacy=0x7fa834046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 msgr2=0x7fa8540ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa844004000 tx=0x7fa844016000 comp rx=0 tx=0).stop 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 shutdown_connections 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa85413e790 0x7fa8540aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8540a9830 0x7fa8540ada00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 --2- 172.21.15.50:0/597762549 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa85413dfe0 0x7fa8540aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 >> 172.21.15.50:0/597762549 conn(0x7fa854062df0 msgr2=0x7fa8540b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:57.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 shutdown_connections 2022-05-02T09:41:57.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.261+0000 7fa85a3ff700 1 -- 172.21.15.50:0/597762549 wait complete. 2022-05-02T09:41:57.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:41:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.513+0000 7f3e9dfff700 1 Processor -- start 2022-05-02T09:41:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.513+0000 7f3e9dfff700 1 -- start start 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e9dfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e9813e790 0x7f3e98146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e9dfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e9dfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980a9310 con 0x7f3e980a9830 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e9dfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980a90a0 con 0x7f3e9813e790 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e9dfff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980a7fe0 con 0x7f3e9813dfe0 2022-05-02T09:41:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.514+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e9813e790 0x7f3e98146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:49996/0 (socket says 172.21.15.50:49996) 2022-05-02T09:41:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e9813e790 0x7f3e98146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36114/0 (socket says 172.21.15.50:36114) 2022-05-02T09:41:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e97fff700 1 -- 172.21.15.50:0/851966806 learned_addr learned my addr 172.21.15.50:0/851966806 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e977fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3e980a9830 0x7f3e980a5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52378/0 (socket says 172.21.15.50:52378) 2022-05-02T09:41:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 -- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 msgr2=0x7f3e981488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 -- 172.21.15.50:0/851966806 >> v1:172.21.15.50:6789/0 conn(0x7f3e980a9830 legacy=0x7f3e980a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 -- 172.21.15.50:0/851966806 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980a8280 con 0x7f3e9813e790 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e97fff700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e967fc700 1 -- 172.21.15.50:0/851966806 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576479231 0 0) 0x7f3e980a9310 con 0x7f3e980a9830 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.515+0000 7f3e96ffd700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9813e790 0x7f3e98146370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009760 tx=0x7f3e8c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03715f8602de966 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e967fc700 1 -- 172.21.15.50:0/851966806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c011630 con 0x7f3e9813e790 2022-05-02T09:41:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e967fc700 1 -- 172.21.15.50:0/851966806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c011790 con 0x7f3e9813e790 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e967fc700 1 -- 172.21.15.50:0/851966806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c011b50 con 0x7f3e9813e790 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 -- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9813e790 msgr2=0x7f3e98146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9813e790 0x7f3e98146370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009760 tx=0x7f3e8c009060 comp rx=0 tx=0).stop 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 -- 172.21.15.50:0/851966806 shutdown_connections 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813dfe0 0x7f3e981488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/851966806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9813e790 0x7f3e98146370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 -- 172.21.15.50:0/851966806 >> 172.21.15.50:0/851966806 conn(0x7f3e98062df0 msgr2=0x7f3e980631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.516+0000 7f3e9dfff700 1 -- 172.21.15.50:0/851966806 shutdown_connections 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.517+0000 7f3e9dfff700 1 -- 172.21.15.50:0/851966806 wait complete. 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.519+0000 7f3e9dfff700 1 Processor -- start 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.519+0000 7f3e9dfff700 1 -- start start 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 0x7f3e980ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 0x7f3e980ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 0x7f3e9814dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980abf70 con 0x7f3e980a9830 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9814d9f0 con 0x7f3e9813dfe0 2022-05-02T09:41:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e9dfff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980aa700 con 0x7f3e9813e790 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 0x7f3e980ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 0x7f3e980ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 0x7f3e980ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50662/0 (socket says 172.21.15.50:50662) 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.520+0000 7f3e96ffd700 1 -- 172.21.15.50:0/839773802 learned_addr learned my addr 172.21.15.50:0/839773802 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 0x7f3e9814dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 -- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 msgr2=0x7f3e980ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 0x7f3e980ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 -- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 msgr2=0x7f3e980ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 0x7f3e980ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 -- 172.21.15.50:0/839773802 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009ae0 con 0x7f3e9813e790 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e977fe700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 0x7f3e980ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.521+0000 7f3e97fff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 0x7f3e9814dbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009f10 tx=0x7f3e9000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.522+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90018070 con 0x7f3e9813e790 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.522+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9000f040 con 0x7f3e9813e790 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.522+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c0092a0 con 0x7f3e9813e790 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.522+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900092e0 con 0x7f3e9813e790 2022-05-02T09:41:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.522+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980acd10 con 0x7f3e9813e790 2022-05-02T09:41:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.523+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980a6b60 con 0x7f3e9813e790 2022-05-02T09:41:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.523+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f3e90014480 con 0x7f3e9813e790 2022-05-02T09:41:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.524+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f3e90059930 con 0x7f3e9813e790 2022-05-02T09:41:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.527+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f3e90038920 con 0x7f3e9813e790 2022-05-02T09:41:57.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.691+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e98068060 con 0x7f3e9813e790 2022-05-02T09:41:57.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.691+0000 7f3e7f7fe700 1 -- 172.21.15.50:0/839773802 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e9003bf40 con 0x7f3e9813e790 2022-05-02T09:41:57.694 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:41:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 >> v1:172.21.15.50:6800/36423 conn(0x7f3e78044b40 legacy=0x7f3e78046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 msgr2=0x7f3e9814dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 0x7f3e9814dbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009f10 tx=0x7f3e9000b040 comp rx=0 tx=0).stop 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 shutdown_connections 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3e9813e790 0x7f3e9814dbe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e980a9830 0x7f3e980ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 --2- 172.21.15.50:0/839773802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e9813dfe0 0x7f3e980ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 >> 172.21.15.50:0/839773802 conn(0x7f3e98062df0 msgr2=0x7f3e980b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 shutdown_connections 2022-05-02T09:41:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.693+0000 7f3e9dfff700 1 -- 172.21.15.50:0/839773802 wait complete. 2022-05-02T09:41:57.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-05-02T09:41:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.943+0000 7f54f49ff700 1 Processor -- start 2022-05-02T09:41:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.943+0000 7f54f49ff700 1 -- start start 2022-05-02T09:41:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54f49ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54f49ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f013dfe0 0x7f54f01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54f49ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00a9310 con 0x7f54f013e790 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54f49ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f00a90a0 con 0x7f54f013dfe0 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54f49ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00a7fe0 con 0x7f54f00a9830 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.944+0000 7f54ee59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54eed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f013dfe0 0x7f54f01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50000/0 (socket says 172.21.15.50:50000) 2022-05-02T09:41:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54edd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54f013e790 0x7f54f0140fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52380/0 (socket says 172.21.15.50:52380) 2022-05-02T09:41:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 -- 172.21.15.50:0/392324414 learned_addr learned my addr 172.21.15.50:0/392324414 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 -- 172.21.15.50:0/392324414 >> v2:172.21.15.50:3300/0 conn(0x7f54f013dfe0 msgr2=0x7f54f01416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 --2- 172.21.15.50:0/392324414 >> v2:172.21.15.50:3300/0 conn(0x7f54f013dfe0 0x7f54f01416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 -- 172.21.15.50:0/392324414 >> v1:172.21.15.50:6789/0 conn(0x7f54f013e790 legacy=0x7f54f0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.945+0000 7f54ee59c700 1 -- 172.21.15.50:0/392324414 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00a8280 con 0x7f54f00a9830 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54ee59c700 1 --2- 172.21.15.50:0/392324414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54e0006fd0 tx=0x7f54e00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235730d855334dfc server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54ed59a700 1 -- 172.21.15.50:0/392324414 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0004030 con 0x7f54f00a9830 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54ed59a700 1 -- 172.21.15.50:0/392324414 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e00041b0 con 0x7f54f00a9830 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54ed59a700 1 -- 172.21.15.50:0/392324414 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0011630 con 0x7f54f00a9830 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 -- 172.21.15.50:0/392324414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 msgr2=0x7f54f00a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 --2- 172.21.15.50:0/392324414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54e0006fd0 tx=0x7f54e00090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 -- 172.21.15.50:0/392324414 shutdown_connections 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 --2- 172.21.15.50:0/392324414 >> v2:172.21.15.50:3300/0 conn(0x7f54f013dfe0 0x7f54f01416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 --2- 172.21.15.50:0/392324414 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f00a9830 0x7f54f00a5800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.946+0000 7f54f49ff700 1 -- 172.21.15.50:0/392324414 >> 172.21.15.50:0/392324414 conn(0x7f54f0062df0 msgr2=0x7f54f00631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.947+0000 7f54f49ff700 1 -- 172.21.15.50:0/392324414 shutdown_connections 2022-05-02T09:41:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.947+0000 7f54f49ff700 1 -- 172.21.15.50:0/392324414 wait complete. 2022-05-02T09:41:57.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.948+0000 7f54f49ff700 1 Processor -- start 2022-05-02T09:41:57.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.948+0000 7f54f49ff700 1 -- start start 2022-05-02T09:41:57.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f013dfe0 0x7f54f00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f013e790 0x7f54f00aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00ae760 con 0x7f54f013e790 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00ac520 con 0x7f54f00a9830 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54f49ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00ac750 con 0x7f54f013dfe0 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54ee59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54edd9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f013dfe0 0x7f54f00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54ee59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50664/0 (socket says 172.21.15.50:50664) 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.949+0000 7f54ee59c700 1 -- 172.21.15.50:0/3151262589 learned_addr learned my addr 172.21.15.50:0/3151262589 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54eed9d700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f013e790 0x7f54f00aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:57.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 -- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f013dfe0 msgr2=0x7f54f00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f013dfe0 0x7f54f00aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 -- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f013e790 msgr2=0x7f54f00aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f013e790 0x7f54f00aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 -- 172.21.15.50:0/3151262589 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009370 con 0x7f54f00a9830 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.950+0000 7f54ee59c700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54e0004000 tx=0x7f54e0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.951+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00034e0 con 0x7f54f00a9830 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.951+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0003640 con 0x7f54f00a9830 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.951+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f00acec0 con 0x7f54f00a9830 2022-05-02T09:41:57.958 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.951+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0003a00 con 0x7f54f00a9830 2022-05-02T09:41:57.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.951+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f00ab850 con 0x7f54f00a9830 2022-05-02T09:41:57.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.952+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f004bfb0 con 0x7f54f00a9830 2022-05-02T09:41:57.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.952+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f54e002b030 con 0x7f54f00a9830 2022-05-02T09:41:57.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.953+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f54e005ae40 con 0x7f54f00a9830 2022-05-02T09:41:57.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:57.957+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f54e002fb50 con 0x7f54f00a9830 2022-05-02T09:41:58.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.115+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54f00a5d40 con 0x7f54f00a9830 2022-05-02T09:41:58.118 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.116+0000 7f54de7fc700 1 -- 172.21.15.50:0/3151262589 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54e0029020 con 0x7f54f00a9830 2022-05-02T09:41:58.119 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 >> v1:172.21.15.50:6800/36423 conn(0x7f54cc044b40 legacy=0x7f54cc046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 msgr2=0x7f54f00adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54e0004000 tx=0x7f54e0016000 comp rx=0 tx=0).stop 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 shutdown_connections 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f013e790 0x7f54f00aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54f00a9830 0x7f54f00adb00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 --2- 172.21.15.50:0/3151262589 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f54f013dfe0 0x7f54f00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 >> 172.21.15.50:0/3151262589 conn(0x7f54f0062df0 msgr2=0x7f54f00b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 shutdown_connections 2022-05-02T09:41:58.122 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.118+0000 7f54f49ff700 1 -- 172.21.15.50:0/3151262589 wait complete. 2022-05-02T09:41:58.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-05-02T09:41:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.367+0000 7f0156bff700 1 Processor -- start 2022-05-02T09:41:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.367+0000 7f0156bff700 1 -- start start 2022-05-02T09:41:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f0156bff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01500704b0 0x7f015013dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f0156bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 0x7f01500ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f0156bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500aaff0 con 0x7f0150141200 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f0156bff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0150070880 con 0x7f01500704b0 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f0156bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015013e340 con 0x7f01500ad490 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.368+0000 7f014ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 0x7f01500ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015519c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0150141200 0x7f0150141680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52382/0 (socket says 172.21.15.50:52382) 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015519c700 1 -- 172.21.15.50:0/2031678084 learned_addr learned my addr 172.21.15.50:0/2031678084 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01500704b0 0x7f015013dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 -- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 msgr2=0x7f01500ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 0x7f01500ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 -- 172.21.15.50:0/2031678084 >> v1:172.21.15.50:6789/0 conn(0x7f0150141200 legacy=0x7f0150141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 -- 172.21.15.50:0/2031678084 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015013e600 con 0x7f01500704b0 2022-05-02T09:41:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f014ffff700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 0x7f01500ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.369+0000 7f015499b700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500704b0 0x7f015013dcb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0144009760 tx=0x7f0144009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e2c65d5d12f08c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f014f7fe700 1 -- 172.21.15.50:0/2031678084 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144011630 con 0x7f01500704b0 2022-05-02T09:41:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f014f7fe700 1 -- 172.21.15.50:0/2031678084 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144011790 con 0x7f01500704b0 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f014f7fe700 1 -- 172.21.15.50:0/2031678084 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144011b50 con 0x7f01500704b0 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 -- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500704b0 msgr2=0x7f015013dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500704b0 0x7f015013dcb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0144009760 tx=0x7f0144009060 comp rx=0 tx=0).stop 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 -- 172.21.15.50:0/2031678084 shutdown_connections 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500704b0 0x7f015013dcb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 --2- 172.21.15.50:0/2031678084 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500ad490 0x7f01500ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 -- 172.21.15.50:0/2031678084 >> 172.21.15.50:0/2031678084 conn(0x7f015006afa0 msgr2=0x7f0150067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.370+0000 7f0156bff700 1 -- 172.21.15.50:0/2031678084 shutdown_connections 2022-05-02T09:41:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.371+0000 7f0156bff700 1 -- 172.21.15.50:0/2031678084 wait complete. 2022-05-02T09:41:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.372+0000 7f0156bff700 1 Processor -- start 2022-05-02T09:41:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.372+0000 7f0156bff700 1 -- start start 2022-05-02T09:41:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 0x7f01501407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0150141200 0x7f015006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015006e790 con 0x7f01500ad490 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500a8a80 con 0x7f0150141200 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f0156bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01500a8d40 con 0x7f01500704b0 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f014ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f015499b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 0x7f01501407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f015519c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0150141200 0x7f015006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f014ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36124/0 (socket says 172.21.15.50:36124) 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f015499b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 0x7f01501407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50006/0 (socket says 172.21.15.50:50006) 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.373+0000 7f014ffff700 1 -- 172.21.15.50:0/1457998102 learned_addr learned my addr 172.21.15.50:0/1457998102 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 -- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 msgr2=0x7f01501407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 0x7f01501407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 -- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0150141200 msgr2=0x7f015006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0150141200 0x7f015006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 -- 172.21.15.50:0/1457998102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0092a0 con 0x7f01500ad490 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014ffff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e9d0 tx=0x7f013c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c013680 con 0x7f01500ad490 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c0137e0 con 0x7f01500ad490 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440092a0 con 0x7f01500ad490 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.374+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c013b80 con 0x7f01500ad490 2022-05-02T09:41:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.375+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01500a9aa0 con 0x7f01500ad490 2022-05-02T09:41:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.376+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015006ea90 con 0x7f01500ad490 2022-05-02T09:41:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.376+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f013c019030 con 0x7f01500ad490 2022-05-02T09:41:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.377+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f013c0598d0 con 0x7f01500ad490 2022-05-02T09:41:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.380+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f015006ea90 con 0x7f01500ad490 2022-05-02T09:41:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.539+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f015006ea90 con 0x7f01500ad490 2022-05-02T09:41:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.539+0000 7f014cff9700 1 -- 172.21.15.50:0/1457998102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f015006ea90 con 0x7f01500ad490 2022-05-02T09:41:58.542 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 >> v1:172.21.15.50:6800/36423 conn(0x7f0138044bc0 legacy=0x7f0138047070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 msgr2=0x7f015006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e9d0 tx=0x7f013c009060 comp rx=0 tx=0).stop 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 shutdown_connections 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f01500704b0 0x7f01501407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0150141200 0x7f015006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 --2- 172.21.15.50:0/1457998102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01500ad490 0x7f015006dac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 >> 172.21.15.50:0/1457998102 conn(0x7f015006afa0 msgr2=0x7f0150141680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 shutdown_connections 2022-05-02T09:41:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.541+0000 7f0156bff700 1 -- 172.21.15.50:0/1457998102 wait complete. 2022-05-02T09:41:58.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:41:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.790+0000 7f0dcaf9d700 1 Processor -- start 2022-05-02T09:41:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.790+0000 7f0dcaf9d700 1 -- start start 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.791+0000 7f0dcaf9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dc40636c0 0x7f0dc41410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.791+0000 7f0dcaf9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc41482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.791+0000 7f0dcaf9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4063a90 con 0x7f0dc41415e0 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.791+0000 7f0dcaf9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40a8eb0 con 0x7f0dc40636c0 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.791+0000 7f0dcaf9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4141a70 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dca79c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc41482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dc9f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dc40636c0 0x7f0dc41410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dc979a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0dc41415e0 0x7f0dc413ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52384/0 (socket says 172.21.15.50:52384) 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dc979a700 1 -- 172.21.15.50:0/460639569 learned_addr learned my addr 172.21.15.50:0/460639569 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dc8f99700 1 -- 172.21.15.50:0/460639569 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802277333 0 0) 0x7f0dc4063a90 con 0x7f0dc41415e0 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dca79c700 1 -- 172.21.15.50:0/460639569 >> v2:172.21.15.50:3300/0 conn(0x7f0dc40636c0 msgr2=0x7f0dc41410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dca79c700 1 --2- 172.21.15.50:0/460639569 >> v2:172.21.15.50:3300/0 conn(0x7f0dc40636c0 0x7f0dc41410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dca79c700 1 -- 172.21.15.50:0/460639569 >> v1:172.21.15.50:6789/0 conn(0x7f0dc41415e0 legacy=0x7f0dc413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.792+0000 7f0dca79c700 1 -- 172.21.15.50:0/460639569 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc4141d30 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dca79c700 1 --2- 172.21.15.50:0/460639569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc41482c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009e60 tx=0x7f0dbc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffbe3bebc5aaeeaf server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dc8f99700 1 -- 172.21.15.50:0/460639569 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e070 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dc8f99700 1 -- 172.21.15.50:0/460639569 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00bb60 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dc8f99700 1 -- 172.21.15.50:0/460639569 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc012430 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/460639569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 msgr2=0x7f0dc41482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/460639569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc41482c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009e60 tx=0x7f0dbc009780 comp rx=0 tx=0).stop 2022-05-02T09:41:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/460639569 shutdown_connections 2022-05-02T09:41:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/460639569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc41482c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/460639569 >> v2:172.21.15.50:3300/0 conn(0x7f0dc40636c0 0x7f0dc41410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.793+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/460639569 >> 172.21.15.50:0/460639569 conn(0x7f0dc4069370 msgr2=0x7f0dc4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.794+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/460639569 shutdown_connections 2022-05-02T09:41:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.794+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/460639569 wait complete. 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.795+0000 7f0dcaf9d700 1 Processor -- start 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.795+0000 7f0dcaf9d700 1 -- start start 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 0x7f0dc40acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc40ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc41415e0 0x7f0dc4139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40ad850 con 0x7f0dc41415e0 2022-05-02T09:41:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40ad5e0 con 0x7f0dc40a9bc0 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dcaf9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40ade60 con 0x7f0dc40636c0 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dc979a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc40ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dc9f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 0x7f0dc40acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dca79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc41415e0 0x7f0dc4139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.796+0000 7f0dc979a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc40ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50670/0 (socket says 172.21.15.50:50670) 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc979a700 1 -- 172.21.15.50:0/797901276 learned_addr learned my addr 172.21.15.50:0/797901276 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 -- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 msgr2=0x7f0dc40ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc40ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 -- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc41415e0 msgr2=0x7f0dc4139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc41415e0 0x7f0dc4139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 -- 172.21.15.50:0/797901276 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009a20 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.797+0000 7f0dc9f9b700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 0x7f0dc40acc00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e8d0 tx=0x7f0dc0006f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.798+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00093f0 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.798+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc0013680 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.798+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc40ae120 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.798+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0013a00 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.798+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40abb50 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.799+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc40abd40 con 0x7f0dc40636c0 2022-05-02T09:41:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.799+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f0dc0019030 con 0x7f0dc40636c0 2022-05-02T09:41:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.800+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f0dc0059590 con 0x7f0dc40636c0 2022-05-02T09:41:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.803+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f0dc0038410 con 0x7f0dc40636c0 2022-05-02T09:41:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.991+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc40697a0 con 0x7f0dc40636c0 2022-05-02T09:41:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.992+0000 7f0db1ffb700 1 -- 172.21.15.50:0/797901276 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3661 (secure 0 0 0) 0x7f0dc003bc00 con 0x7f0dc40636c0 2022-05-02T09:41:58.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:41:58.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6817/2631764917","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":2631764917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6818/2504557113","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":2504557113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:40:06.686111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/3706979787","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":3706979787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:41:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 >> v1:172.21.15.50:6800/36423 conn(0x7f0da4044b40 legacy=0x7f0da4046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 msgr2=0x7f0dc40acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 0x7f0dc40acc00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e8d0 tx=0x7f0dc0006f40 comp rx=0 tx=0).stop 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 shutdown_connections 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0dc40636c0 0x7f0dc40acc00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc41415e0 0x7f0dc4139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 --2- 172.21.15.50:0/797901276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0dc40a9bc0 0x7f0dc40ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 >> 172.21.15.50:0/797901276 conn(0x7f0dc4069370 msgr2=0x7f0dc41406d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 shutdown_connections 2022-05-02T09:41:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:58.994+0000 7f0dcaf9d700 1 -- 172.21.15.50:0/797901276 wait complete. 2022-05-02T09:41:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2022-05-02T09:41:59.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-05-02T09:39:11.302771+0000', 'modified': '2022-05-02T09:40:06.686111+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4257}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6819/3706979787', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 3706979787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-05-02T09:41:59.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-05-02T09:41:59.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-05-02T09:41:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.553+0000 7fe1fc9fe700 1 Processor -- start 2022-05-02T09:41:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.553+0000 7fe1fc9fe700 1 -- start start 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1fc9fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1f80636c0 0x7fe1f8141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1fc9fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f81419c0 0x7fe1f813e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1fc9fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f8140ff0 con 0x7fe1f80a9bf0 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1fc9fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f8063a90 con 0x7fe1f80636c0 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1fc9fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80a9200 con 0x7fe1f81419c0 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1f659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f81419c0 0x7fe1f813e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1f759e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1f80a9bf0 0x7fe1f80a4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52386/0 (socket says 172.21.15.50:52386) 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1f6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1f80636c0 0x7fe1f8141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.554+0000 7fe1f759e700 1 -- 172.21.15.50:0/2535183447 learned_addr learned my addr 172.21.15.50:0/2535183447 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:41:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f81419c0 msgr2=0x7fe1f813e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f81419c0 0x7fe1f813e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2535183447 >> v1:172.21.15.50:6789/0 conn(0x7fe1f80a9bf0 legacy=0x7fe1f80a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2535183447 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8141e50 con 0x7fe1f80636c0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f5d9b700 1 -- 172.21.15.50:0/2535183447 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376332494 0 0) 0x7fe1f8140ff0 con 0x7fe1f80a9bf0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.555+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f8141480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009760 tx=0x7fe1e8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e54d2b8ac8ec8e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1f5d9b700 1 -- 172.21.15.50:0/2535183447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011630 con 0x7fe1f80636c0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1f5d9b700 1 -- 172.21.15.50:0/2535183447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8011790 con 0x7fe1f80636c0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1f5d9b700 1 -- 172.21.15.50:0/2535183447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011b50 con 0x7fe1f80636c0 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 msgr2=0x7fe1f8141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f8141480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009760 tx=0x7fe1e8009060 comp rx=0 tx=0).stop 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/2535183447 shutdown_connections 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f8141480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/2535183447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f81419c0 0x7fe1f813e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/2535183447 >> 172.21.15.50:0/2535183447 conn(0x7fe1f8069370 msgr2=0x7fe1f8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/2535183447 shutdown_connections 2022-05-02T09:41:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.556+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/2535183447 wait complete. 2022-05-02T09:41:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.558+0000 7fe1fc9fe700 1 Processor -- start 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.558+0000 7fe1fc9fe700 1 -- start start 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f80a9bf0 0x7fe1f80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe1f81419c0 0x7fe1f80aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80af1f0 con 0x7fe1f80636c0 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f813d640 con 0x7fe1f80a9bf0 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1fc9fe700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80ae2e0 con 0x7fe1f81419c0 2022-05-02T09:41:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1f659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f80a9bf0 0x7fe1f80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36134/0 (socket says 172.21.15.50:36134) 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/4150031917 learned_addr learned my addr 172.21.15.50:0/4150031917 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.559+0000 7fe1f759e700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe1f81419c0 0x7fe1f80aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe1f81419c0 msgr2=0x7fe1f80aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe1f81419c0 0x7fe1f80aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f80a9bf0 msgr2=0x7fe1f80ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f80a9bf0 0x7fe1f80ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/4150031917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80092a0 con 0x7fe1f80636c0 2022-05-02T09:41:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011fc0 tx=0x7fe1e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1deffd700 1 -- 172.21.15.50:0/4150031917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8000bc0 con 0x7fe1f80636c0 2022-05-02T09:41:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1deffd700 1 -- 172.21.15.50:0/4150031917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8011900 con 0x7fe1f80636c0 2022-05-02T09:41:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1deffd700 1 -- 172.21.15.50:0/4150031917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8025420 con 0x7fe1f80636c0 2022-05-02T09:41:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.560+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f80ac8f0 con 0x7fe1f80636c0 2022-05-02T09:41:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.561+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f80ab6b0 con 0x7fe1f80636c0 2022-05-02T09:41:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.562+0000 7fe1deffd700 1 -- 172.21.15.50:0/4150031917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fe1e802c030 con 0x7fe1f80636c0 2022-05-02T09:41:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.563+0000 7fe1deffd700 1 -- 172.21.15.50:0/4150031917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fe1e805ad60 con 0x7fe1f80636c0 2022-05-02T09:41:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.566+0000 7fe20c43db80 1 Processor -- start 2022-05-02T09:41:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.566+0000 7fe20c43db80 1 -- start start 2022-05-02T09:41:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df5d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df5d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56303deb2970 con 0x56303df60140 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x56303de2b3d0 con 0x56303df3dc80 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x56303de94c20 con 0x56303df612e0 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50676/0 (socket says 172.21.15.50:50676) 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1405441297 learned_addr learned my addr 172.21.15.50:0/1405441297 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f759e700 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df5d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f659c700 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df5d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 msgr2=0x56303df5d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df5d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 msgr2=0x56303df5d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.567+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df5d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.568+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1405441297 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56303dd0cdf0 con 0x56303df3dc80 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.568+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e8012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c8a57ab0adb3df3 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.568+0000 7fe1d3fff700 1 -- 172.21.15.50:0/1405441297 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e804e070 con 0x56303df3dc80 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.568+0000 7fe1d3fff700 1 -- 172.21.15.50:0/1405441297 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e802f440 con 0x56303df3dc80 2022-05-02T09:41:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.568+0000 7fe1d3fff700 1 -- 172.21.15.50:0/1405441297 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8007d30 con 0x56303df3dc80 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 -- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 msgr2=0x56303df3ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009e80 tx=0x7fe1e8012000 comp rx=0 tx=0).stop 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 -- 172.21.15.50:0/1405441297 shutdown_connections 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df5d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df3ea80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1405441297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df5d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 -- 172.21.15.50:0/1405441297 >> 172.21.15.50:0/1405441297 conn(0x56303df3c5c0 msgr2=0x56303df3fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 -- 172.21.15.50:0/1405441297 shutdown_connections 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.569+0000 7fe20c43db80 1 -- 172.21.15.50:0/1405441297 wait complete. 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.570+0000 7fe20c43db80 1 -- start start 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.570+0000 7fe20c43db80 1 Processor -- start 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df598c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df59e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56303de8ed00 con 0x56303df3dc80 2022-05-02T09:41:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x56303dd89040 con 0x56303df612e0 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x56303df6ef70 con 0x56303df60140 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe20c43db80 10 client.0 _ll_register_callbacks cb 0x56303dd8b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe1f659c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe1f759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df59e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36138/0 (socket says 172.21.15.50:36138) 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.571+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2905031915 learned_addr learned my addr 172.21.15.50:0/2905031915 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 msgr2=0x56303df598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 msgr2=0x56303df59e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df59e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/2905031915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f80ab6b0 con 0x56303df3dc80 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f659c700 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f759e700 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df59e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011f90 tx=0x7fe1e8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690f08fb0ff2bd90 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8058070 con 0x56303df3dc80 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fe1e8008ed0 con 0x56303df3dc80 2022-05-02T09:41:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.572+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56303de561d0 con 0x56303df3dc80 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e802f670 con 0x56303df3dc80 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 10 client.14415 fetch_fsmap learned FSMap version 15 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=3+}) v3 -- 0x56303dccefe0 con 0x56303df3dc80 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56303de561d0 con 0x56303df3dc80 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 2454+0+0 (secure 0 0 0) 0x7fe1e803f050 con 0x56303df3dc80 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 10 client.14415 fetch_fsmap finished waiting for FSMap version 15 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 10 client.14415 resolve_mds: resolved name 'c' to daemon mds.c 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 20 client.14415 populate_metadata read hostname 'smithi050' 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 4 client.14415 mds_command: new command op to 4257 tid=0[{"prefix": "get_command_descriptions"}] 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.573+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56303de30d60 con 0x56303df6d720 2022-05-02T09:41:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.574+0000 7fe1d17fa700 10 client.14415 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:41:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.574+0000 7fe1d17fa700 1 -- 172.21.15.50:0/2905031915 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x56303de30d60 con 0x56303df6d720 2022-05-02T09:41:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.574+0000 7fe1d17fa700 10 client.14415 handle_command_reply: tid=0 2022-05-02T09:41:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 client.14415 shutdown 2022-05-02T09:41:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 msgr2=0x56303df70c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011f90 tx=0x7fe1e8031000 comp rx=0 tx=0).stop 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 shutdown_connections 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df59e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df70c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe1d17fa700 0 client.14415 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 --2- 172.21.15.50:0/2905031915 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 >> 172.21.15.50:0/2905031915 conn(0x56303df3c5c0 msgr2=0x56303df38f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 shutdown_connections 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 1 -- 172.21.15.50:0/2905031915 wait complete. 2022-05-02T09:41:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.575+0000 7fe20c43db80 20 client.14415 trim_cache size 0 max 16384 2022-05-02T09:41:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 Processor -- start 2022-05-02T09:41:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 -- start start 2022-05-02T09:41:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df59800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df59d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56303df71940 con 0x56303df60140 2022-05-02T09:41:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x56303de30d60 con 0x56303df3dc80 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.594+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x56303de561d0 con 0x56303df612e0 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df59800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50682/0 (socket says 172.21.15.50:50682) 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/114172080 learned_addr learned my addr 172.21.15.50:0/114172080 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f759e700 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df59d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 msgr2=0x56303df59d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df59d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 msgr2=0x56303df59800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df59800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.595+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/114172080 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56303dd83c80 con 0x56303df3dc80 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8020040 tx=0x7fe1e8058000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf516c23f7e27fd7 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe1dc9ff700 1 -- 172.21.15.50:0/114172080 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e802f670 con 0x56303df3dc80 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe1dc9ff700 1 -- 172.21.15.50:0/114172080 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8003a00 con 0x56303df3dc80 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe1dc9ff700 1 -- 172.21.15.50:0/114172080 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8008ed0 con 0x56303df3dc80 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe20c43db80 1 -- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 msgr2=0x56303df38f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.596+0000 7fe20c43db80 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8020040 tx=0x7fe1e8058000 comp rx=0 tx=0).stop 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 -- 172.21.15.50:0/114172080 shutdown_connections 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df612e0 0x56303df59d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df3dc80 0x56303df38f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 --2- 172.21.15.50:0/114172080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df60140 0x56303df59800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 -- 172.21.15.50:0/114172080 >> 172.21.15.50:0/114172080 conn(0x56303df3c5c0 msgr2=0x56303df36de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 -- 172.21.15.50:0/114172080 shutdown_connections 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 -- 172.21.15.50:0/114172080 wait complete. 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.597+0000 7fe20c43db80 1 -- start start 2022-05-02T09:41:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.598+0000 7fe20c43db80 1 Processor -- start 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56303df5e750 con 0x56303df3dc80 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x56303df67ff0 con 0x56303df612e0 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x56303df87260 con 0x56303df60140 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.599+0000 7fe20c43db80 10 client.0 _ll_register_callbacks cb 0x7fe1e8028070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f659c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36142/0 (socket says 172.21.15.50:36142) 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1584894239 learned_addr learned my addr 172.21.15.50:0/1584894239 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f759e700 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 msgr2=0x56303df398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df398f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 msgr2=0x56303df39e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df39e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 -- 172.21.15.50:0/1584894239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56303dccefe0 con 0x56303df3dc80 2022-05-02T09:41:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1f6d9d700 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8003b70 tx=0x7fe1e800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a9db8d6c8ac1a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.600+0000 7fe1d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8058040 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fe1e8027680 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e802f440 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e80071b0 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe20c43db80 10 client.14421 fetch_fsmap learned FSMap version 15 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.601+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=3+}) v3 -- 0x56303dcd0b10 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e802f440 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 2454+0+0 (secure 0 0 0) 0x7fe1e803f040 con 0x56303df3dc80 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe20c43db80 10 client.14421 fetch_fsmap finished waiting for FSMap version 15 2022-05-02T09:41:59.607 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe20c43db80 10 client.14421 resolve_mds: resolved name 'c' to daemon mds.c 2022-05-02T09:41:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe20c43db80 20 client.14421 populate_metadata read hostname 'smithi050' 2022-05-02T09:41:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe20c43db80 4 client.14421 mds_command: new command op to 4257 tid=0[{"prefix": "status"}] 2022-05-02T09:41:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.602+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 --> v1:172.21.15.50:6819/3706979787 -- command(tid 0: {"prefix": "status"}) v1 -- 0x56303de33930 con 0x56303df3a370 2022-05-02T09:41:59.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe1d17fa700 10 client.14421 ms_handle_connect on v1:172.21.15.50:6819/3706979787 2022-05-02T09:41:59.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe1d17fa700 1 -- 172.21.15.50:0/1584894239 <== mds.0 v1:172.21.15.50:6819/3706979787 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+301 (unknown 0 0 2284021563) 0x56303de33930 con 0x56303df3a370 2022-05-02T09:41:59.609 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe1d17fa700 10 client.14421 handle_command_reply: tid=0 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe20c43db80 1 client.14421 shutdown 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 msgr2=0x56303df5e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.603+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8003b70 tx=0x7fe1e800d000 comp rx=0 tx=0).stop 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 shutdown_connections 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x56303df612e0 0x56303df39e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56303df3dc80 0x56303df5e210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 --2- 172.21.15.50:0/1584894239 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x56303df60140 0x56303df398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 >> 172.21.15.50:0/1584894239 conn(0x56303df3c5c0 msgr2=0x56303df38f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe1d17fa700 0 client.14421 ms_handle_reset on v1:172.21.15.50:6819/3706979787 2022-05-02T09:41:59.610 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 shutdown_connections 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 1 -- 172.21.15.50:0/1584894239 wait complete. 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.604+0000 7fe20c43db80 20 client.14421 trim_cache size 0 max 16384 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "7c52b71c-589c-4ac2-936d-4a721101e437", 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4257, 2022-05-02T09:41:59.611 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 168.29918813800001, 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 14, 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 23, 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 20, 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 178.778728806 2022-05-02T09:41:59.612 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:41:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 >> v1:172.21.15.50:6800/36423 conn(0x7fe1d8044bf0 legacy=0x7fe1d80470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 msgr2=0x7fe1f813d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011fc0 tx=0x7fe1e8017000 comp rx=0 tx=0).stop 2022-05-02T09:41:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 shutdown_connections 2022-05-02T09:41:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe1f81419c0 0x7fe1f80aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80636c0 0x7fe1f813d0d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 --2- 172.21.15.50:0/4150031917 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1f80a9bf0 0x7fe1f80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.605+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 >> 172.21.15.50:0/4150031917 conn(0x7fe1f8069370 msgr2=0x7fe1f813abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.606+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 shutdown_connections 2022-05-02T09:41:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.606+0000 7fe1fc9fe700 1 -- 172.21.15.50:0/4150031917 wait complete. 2022-05-02T09:41:59.632 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-05-02T09:41:59.644 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-05-02T09:41:59.644 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:41:59.699 INFO:tasks.ceph.osd.0:Stopped 2022-05-02T09:41:59.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2022-05-02T09:41:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.920+0000 7f56215ff700 1 Processor -- start 2022-05-02T09:41:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.920+0000 7f56215ff700 1 -- start start 2022-05-02T09:41:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.921+0000 7f56215ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c0a34f0 0x7f561c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.921+0000 7f56215ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f561c141610 0x7f561c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.921+0000 7f56215ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c0682a0 con 0x7f561c141f60 2022-05-02T09:41:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.921+0000 7f56215ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c0a38c0 con 0x7f561c141610 2022-05-02T09:41:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.921+0000 7f56215ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f561c06a270 con 0x7f561c0a34f0 2022-05-02T09:41:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f561c141610 0x7f561c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561affd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c0a34f0 0x7f561c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f561c141610 0x7f561c141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36144/0 (socket says 172.21.15.50:36144) 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 -- 172.21.15.50:0/3531046287 learned_addr learned my addr 172.21.15.50:0/3531046287 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561b7fe700 1 --1- 172.21.15.50:0/3531046287 >> v1:172.21.15.50:6789/0 conn(0x7f561c141f60 0x7f561c06e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52388/0 (socket says 172.21.15.50:52388) 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 -- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c0a34f0 msgr2=0x7f561c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 --2- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c0a34f0 0x7f561c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 -- 172.21.15.50:0/3531046287 >> v1:172.21.15.50:6789/0 conn(0x7f561c141f60 legacy=0x7f561c06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.922+0000 7f561a7fc700 1 -- 172.21.15.50:0/3531046287 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0af800 con 0x7f561c141610 2022-05-02T09:41:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f561a7fc700 1 --2- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c141610 0x7f561c141a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5610006fd0 tx=0x7f56100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a097edf02ab77e1 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f5619ffb700 1 -- 172.21.15.50:0/3531046287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610004030 con 0x7f561c141610 2022-05-02T09:41:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f5619ffb700 1 -- 172.21.15.50:0/3531046287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100041b0 con 0x7f561c141610 2022-05-02T09:41:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f5619ffb700 1 -- 172.21.15.50:0/3531046287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610011630 con 0x7f561c141610 2022-05-02T09:41:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f56215ff700 1 -- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c141610 msgr2=0x7f561c141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f56215ff700 1 --2- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c141610 0x7f561c141a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5610006fd0 tx=0x7f56100090f0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.923+0000 7f56215ff700 1 -- 172.21.15.50:0/3531046287 shutdown_connections 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.924+0000 7f56215ff700 1 --2- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c0a34f0 0x7f561c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.924+0000 7f56215ff700 1 --2- 172.21.15.50:0/3531046287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c141610 0x7f561c141a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.924+0000 7f56215ff700 1 -- 172.21.15.50:0/3531046287 >> 172.21.15.50:0/3531046287 conn(0x7f561c062df0 msgr2=0x7f561c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.924+0000 7f56215ff700 1 -- 172.21.15.50:0/3531046287 shutdown_connections 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.924+0000 7f56215ff700 1 -- 172.21.15.50:0/3531046287 wait complete. 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.926+0000 7f56215ff700 1 Processor -- start 2022-05-02T09:41:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.926+0000 7f56215ff700 1 -- start start 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 0x7f561c097f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 0x7f561c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c098900 con 0x7f561c0a34f0 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c099620 con 0x7f561c141610 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f56215ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f561c099b30 con 0x7f561c141f60 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.927+0000 7f561affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 0x7f561c097f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36146/0 (socket says 172.21.15.50:36146) 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561affd700 1 -- 172.21.15.50:0/230628583 learned_addr learned my addr 172.21.15.50:0/230628583 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561b7fe700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 0x7f561c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 -- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 msgr2=0x7f561c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 0x7f561c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 -- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 msgr2=0x7f561c09a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561a7fc700 1 -- 172.21.15.50:0/230628583 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009370 con 0x7f561c141610 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561b7fe700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 0x7f561c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.928+0000 7f561affd700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f561a7fc700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 0x7f561c097f30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5610015000 tx=0x7f5610016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610011630 con 0x7f561c141610 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100034e0 con 0x7f561c141610 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100038a0 con 0x7f561c141610 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c0992a0 con 0x7f561c141610 2022-05-02T09:41:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.929+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c099850 con 0x7f561c141610 2022-05-02T09:41:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.930+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c04bfb0 con 0x7f561c141610 2022-05-02T09:41:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.930+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f5610017020 con 0x7f561c141610 2022-05-02T09:41:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.931+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f561005aff0 con 0x7f561c141610 2022-05-02T09:41:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:41:59.935+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f5610081e50 con 0x7f561c141610 2022-05-02T09:42:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.104+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f561c068b80 con 0x7f561c141610 2022-05-02T09:42:00.107 INFO:tasks.ceph.mon.a.smithi050.stderr:2022-05-02T09:42:00.105+0000 7f38801f4700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2022-05-02T09:42:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.618+0000 7f5602ffd700 1 -- 172.21.15.50:0/230628583 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f5610045080 con 0x7f561c141610 2022-05-02T09:42:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.621+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 >> v1:172.21.15.50:6800/36423 conn(0x7f55fc044b40 legacy=0x7f55fc046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.621+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 msgr2=0x7f561c097f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.621+0000 7f56215ff700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 0x7f561c097f30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5610015000 tx=0x7f5610016000 comp rx=0 tx=0).stop 2022-05-02T09:42:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.622+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 shutdown_connections 2022-05-02T09:42:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.622+0000 7f56215ff700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f561c141f60 0x7f561c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.622+0000 7f56215ff700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561c0a34f0 0x7f561c09a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.622+0000 7f56215ff700 1 --2- 172.21.15.50:0/230628583 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f561c141610 0x7f561c097f30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.622+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 >> 172.21.15.50:0/230628583 conn(0x7f561c062df0 msgr2=0x7f561c069140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.623+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 shutdown_connections 2022-05-02T09:42:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.624+0000 7f56215ff700 1 -- 172.21.15.50:0/230628583 wait complete. 2022-05-02T09:42:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:marked down osd.0. 2022-05-02T09:42:00.657 INFO:tasks.ceph.osd.0:Restarting daemon 2022-05-02T09:42:00.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-05-02T09:42:00.664 INFO:tasks.ceph.osd.0:Started 2022-05-02T09:42:00.664 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-05-02T09:42:00.664 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:00.733 INFO:tasks.ceph.osd.1:Stopped 2022-05-02T09:42:00.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2022-05-02T09:42:00.961 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.959+0000 7f47473ff700 1 Processor -- start 2022-05-02T09:42:00.962 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.959+0000 7f47473ff700 1 -- start start 2022-05-02T09:42:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f47473ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f47473ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47401488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f47473ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400a9310 con 0x7f47400a9830 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f47473ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47400a90a0 con 0x7f474013e790 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f47473ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47400a7fe0 con 0x7f474013dfe0 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f474499a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.960+0000 7f474599c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47401488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474499a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36148/0 (socket says 172.21.15.50:36148) 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474499a700 1 -- 172.21.15.50:0/3620045707 learned_addr learned my addr 172.21.15.50:0/3620045707 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474519b700 1 --1- 172.21.15.50:0/3620045707 >> v1:172.21.15.50:6789/0 conn(0x7f47400a9830 0x7f47400a5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52392/0 (socket says 172.21.15.50:52392) 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474599c700 1 -- 172.21.15.50:0/3620045707 >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 msgr2=0x7f4740146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474599c700 1 --2- 172.21.15.50:0/3620045707 >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474599c700 1 -- 172.21.15.50:0/3620045707 >> v1:172.21.15.50:6789/0 conn(0x7f47400a9830 legacy=0x7f47400a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474599c700 1 -- 172.21.15.50:0/3620045707 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400a8280 con 0x7f474013dfe0 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474499a700 1 --2- 172.21.15.50:0/3620045707 >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:00.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.961+0000 7f474599c700 1 --2- 172.21.15.50:0/3620045707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47401488c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4738009e60 tx=0x7f4738009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a3d3fb82d54eff server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:00.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f472ffff700 1 -- 172.21.15.50:0/3620045707 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800e070 con 0x7f474013dfe0 2022-05-02T09:42:00.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f472ffff700 1 -- 172.21.15.50:0/3620045707 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800bb60 con 0x7f474013dfe0 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f472ffff700 1 -- 172.21.15.50:0/3620045707 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738012430 con 0x7f474013dfe0 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 -- 172.21.15.50:0/3620045707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 msgr2=0x7f47401488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 --2- 172.21.15.50:0/3620045707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47401488c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4738009e60 tx=0x7f4738009780 comp rx=0 tx=0).stop 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 -- 172.21.15.50:0/3620045707 shutdown_connections 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 --2- 172.21.15.50:0/3620045707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47401488c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 --2- 172.21.15.50:0/3620045707 >> v2:172.21.15.50:3300/0 conn(0x7f474013e790 0x7f4740146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 -- 172.21.15.50:0/3620045707 >> 172.21.15.50:0/3620045707 conn(0x7f4740062df0 msgr2=0x7f47400631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 -- 172.21.15.50:0/3620045707 shutdown_connections 2022-05-02T09:42:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.962+0000 7f47473ff700 1 -- 172.21.15.50:0/3620045707 wait complete. 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.964+0000 7f47473ff700 1 Processor -- start 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.964+0000 7f47473ff700 1 -- start start 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 0x7f47400aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f474013e790 0x7f47400aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400aca10 con 0x7f47400a9830 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47400accd0 con 0x7f474013dfe0 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f47473ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47401419c0 con 0x7f474013e790 2022-05-02T09:42:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f474499a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:00.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f474499a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50694/0 (socket says 172.21.15.50:50694) 2022-05-02T09:42:00.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f474519b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 0x7f47400aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:00.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f474499a700 1 -- 172.21.15.50:0/2602748542 learned_addr learned my addr 172.21.15.50:0/2602748542 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:00.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.965+0000 7f474599c700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f474013e790 0x7f47400aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 -- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f474013e790 msgr2=0x7f47400aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f474013e790 0x7f47400aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 -- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 msgr2=0x7f47400aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 0x7f47400aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 -- 172.21.15.50:0/2602748542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4730009370 con 0x7f474013dfe0 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474519b700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 0x7f47400aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f474499a700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f473000ea50 tx=0x7f47300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000ee90 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473000c7f0 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738009a20 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000cb70 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.966+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47400b12a0 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.968+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47400aec00 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.968+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f4730019030 con 0x7f474013dfe0 2022-05-02T09:42:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.969+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f47300598b0 con 0x7f474013dfe0 2022-05-02T09:42:00.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:00.972+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f47300387d0 con 0x7f474013dfe0 2022-05-02T09:42:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.143+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f474004bfb0 con 0x7f474013dfe0 2022-05-02T09:42:01.146 INFO:tasks.ceph.mon.a.smithi050.stderr:2022-05-02T09:42:01.144+0000 7f38801f4700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2022-05-02T09:42:01.356 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:01.354+0000 7f20cfcb83c0 -1 Falling back to public interface 2022-05-02T09:42:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.623+0000 7f472d7fa700 1 -- 172.21.15.50:0/2602748542 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f4730058650 con 0x7f474013dfe0 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 >> v1:172.21.15.50:6800/36423 conn(0x7f4720044b70 legacy=0x7f4720047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 msgr2=0x7f47400ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f473000ea50 tx=0x7f47300090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 shutdown_connections 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f474013e790 0x7f47400aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47400a9830 0x7f47400aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 --2- 172.21.15.50:0/2602748542 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f474013dfe0 0x7f47400ad880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.627+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 >> 172.21.15.50:0/2602748542 conn(0x7f4740062df0 msgr2=0x7f47400b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.632+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 shutdown_connections 2022-05-02T09:42:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.633+0000 7f47473ff700 1 -- 172.21.15.50:0/2602748542 wait complete. 2022-05-02T09:42:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:marked down osd.1. 2022-05-02T09:42:01.668 INFO:tasks.ceph.osd.1:Restarting daemon 2022-05-02T09:42:01.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-05-02T09:42:01.673 INFO:tasks.ceph.osd.1:Started 2022-05-02T09:42:01.674 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-05-02T09:42:01.674 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:01.745 INFO:tasks.ceph.osd.2:Stopped 2022-05-02T09:42:01.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2022-05-02T09:42:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.971+0000 7fa83559d700 1 Processor -- start 2022-05-02T09:42:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.971+0000 7fa83559d700 1 -- start start 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa83559d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa83559d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8300b3d80 0x7fa83013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa83559d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300a5cf0 con 0x7fa8300b4170 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa83559d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300a7c20 con 0x7fa8300b3d80 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa83559d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300a7ee0 con 0x7fa8300a84d0 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa82f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8300b3d80 0x7fa83013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50698/0 (socket says 172.21.15.50:50698) 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa82f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8300b3d80 0x7fa83013a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36156/0 (socket says 172.21.15.50:36156) 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.972+0000 7fa82ffff700 1 -- 172.21.15.50:0/2780248335 learned_addr learned my addr 172.21.15.50:0/2780248335 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82f7fe700 1 -- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 msgr2=0x7fa8300a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82f7fe700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82f7fe700 1 -- 172.21.15.50:0/2780248335 >> v1:172.21.15.50:6789/0 conn(0x7fa8300b4170 legacy=0x7fa83013ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82f7fe700 1 -- 172.21.15.50:0/2780248335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300a88a0 con 0x7fa8300b3d80 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82ffff700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.973+0000 7fa82f7fe700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300b3d80 0x7fa83013a8d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa824009760 tx=0x7fa824009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ada79680f9dd8 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa82effd700 1 -- 172.21.15.50:0/2780248335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824011630 con 0x7fa8300b3d80 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa82effd700 1 -- 172.21.15.50:0/2780248335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824011790 con 0x7fa8300b3d80 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa82effd700 1 -- 172.21.15.50:0/2780248335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824011b50 con 0x7fa8300b3d80 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 -- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300b3d80 msgr2=0x7fa83013a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300b3d80 0x7fa83013a8d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa824009760 tx=0x7fa824009060 comp rx=0 tx=0).stop 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 -- 172.21.15.50:0/2780248335 shutdown_connections 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300a84d0 0x7fa8300a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 --2- 172.21.15.50:0/2780248335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300b3d80 0x7fa83013a8d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 -- 172.21.15.50:0/2780248335 >> 172.21.15.50:0/2780248335 conn(0x7fa830069350 msgr2=0x7fa8300674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 -- 172.21.15.50:0/2780248335 shutdown_connections 2022-05-02T09:42:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.974+0000 7fa83559d700 1 -- 172.21.15.50:0/2780248335 wait complete. 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.976+0000 7fa83559d700 1 Processor -- start 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.976+0000 7fa83559d700 1 -- start start 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300b3d80 0x7fa830140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa8300b4170 0x7fa83014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83014e470 con 0x7fa8300a84d0 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83014e1b0 con 0x7fa8300b3d80 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa83559d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8301412e0 con 0x7fa8300b4170 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36158/0 (socket says 172.21.15.50:36158) 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa82ffff700 1 -- 172.21.15.50:0/60908059 learned_addr learned my addr 172.21.15.50:0/60908059 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa82f7fe700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300b3d80 0x7fa830140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.977+0000 7fa834d9c700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa8300b4170 0x7fa83014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 -- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa8300b4170 msgr2=0x7fa83014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa8300b4170 0x7fa83014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 -- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300b3d80 msgr2=0x7fa830140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300b3d80 0x7fa830140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 -- 172.21.15.50:0/60908059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820009370 con 0x7fa8300a84d0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa82ffff700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa82000ea20 tx=0x7fa8200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820009650 con 0x7fa8300a84d0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000ee60 con 0x7fa8300a84d0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8240092a0 con 0x7fa8300a84d0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.978+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000caa0 con 0x7fa8300a84d0 2022-05-02T09:42:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.979+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83014df60 con 0x7fa8300a84d0 2022-05-02T09:42:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.980+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8301414a0 con 0x7fa8300a84d0 2022-05-02T09:42:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.980+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fa820023070 con 0x7fa8300a84d0 2022-05-02T09:42:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.981+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa820059a70 con 0x7fa8300a84d0 2022-05-02T09:42:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:01.984+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fa820038ac0 con 0x7fa8300a84d0 2022-05-02T09:42:02.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.153+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fa830068ea0 con 0x7fa8300a84d0 2022-05-02T09:42:02.156 INFO:tasks.ceph.mon.a.smithi050.stderr:2022-05-02T09:42:02.154+0000 7f38801f4700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2022-05-02T09:42:02.357 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:02.355+0000 7f7cce2b13c0 -1 Falling back to public interface 2022-05-02T09:42:02.630 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.627+0000 7fa817fff700 1 -- 172.21.15.50:0/60908059 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7fa82003c0e0 con 0x7fa8300a84d0 2022-05-02T09:42:02.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.631+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 >> v1:172.21.15.50:6800/36423 conn(0x7fa810044b40 legacy=0x7fa810046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.631+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 msgr2=0x7fa83013d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.631+0000 7fa83559d700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa82000ea20 tx=0x7fa8200090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 shutdown_connections 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa8300b4170 0x7fa83014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8300a84d0 0x7fa83013d160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 --2- 172.21.15.50:0/60908059 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8300b3d80 0x7fa830140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 >> 172.21.15.50:0/60908059 conn(0x7fa830069350 msgr2=0x7fa830063540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 shutdown_connections 2022-05-02T09:42:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.632+0000 7fa83559d700 1 -- 172.21.15.50:0/60908059 wait complete. 2022-05-02T09:42:02.637 INFO:teuthology.orchestra.run.smithi050.stderr:marked down osd.2. 2022-05-02T09:42:02.664 INFO:tasks.ceph.osd.2:Restarting daemon 2022-05-02T09:42:02.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-05-02T09:42:02.670 INFO:tasks.ceph.osd.2:Started 2022-05-02T09:42:02.670 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2022-05-02T09:42:02.670 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:02.740 INFO:tasks.ceph.osd.3:Stopped 2022-05-02T09:42:02.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2022-05-02T09:42:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.962+0000 7f68195ff700 1 Processor -- start 2022-05-02T09:42:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.962+0000 7f68195ff700 1 -- start start 2022-05-02T09:42:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.963+0000 7f68195ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 0x7f681413dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.963+0000 7f68195ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 0x7f68140ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.963+0000 7f68195ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68140aaff0 con 0x7f6814141200 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.963+0000 7f68195ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6814070880 con 0x7f68140ad490 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.963+0000 7f68195ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f681413e340 con 0x7f68140704b0 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68137fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6814141200 0x7f68141416a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52396/0 (socket says 172.21.15.50:52396) 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f6812ffd700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 0x7f681413dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68137fe700 1 -- 172.21.15.50:0/3026992184 learned_addr learned my addr 172.21.15.50:0/3026992184 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68127fc700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 0x7f68140ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68127fc700 1 -- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 msgr2=0x7f681413dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68127fc700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 0x7f681413dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68127fc700 1 -- 172.21.15.50:0/3026992184 >> v1:172.21.15.50:6789/0 conn(0x7f6814141200 legacy=0x7f68141416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f68127fc700 1 -- 172.21.15.50:0/3026992184 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681413e600 con 0x7f68140ad490 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f6812ffd700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 0x7f681413dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.964+0000 7f6811ffb700 1 -- 172.21.15.50:0/3026992184 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398641979 0 0) 0x7f68140aaff0 con 0x7f6814141200 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f68127fc700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 0x7f68140ad8e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6808009790 tx=0x7f6808009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85ce2fb13003b0f5 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f6811ffb700 1 -- 172.21.15.50:0/3026992184 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011630 con 0x7f68140ad490 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f6811ffb700 1 -- 172.21.15.50:0/3026992184 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808011790 con 0x7f68140ad490 2022-05-02T09:42:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f6811ffb700 1 -- 172.21.15.50:0/3026992184 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011b30 con 0x7f68140ad490 2022-05-02T09:42:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f68195ff700 1 -- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 msgr2=0x7f68140ad8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.965+0000 7f68195ff700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 0x7f68140ad8e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6808009790 tx=0x7f6808009060 comp rx=0 tx=0).stop 2022-05-02T09:42:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 -- 172.21.15.50:0/3026992184 shutdown_connections 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140704b0 0x7f681413dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 --2- 172.21.15.50:0/3026992184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140ad490 0x7f68140ad8e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 -- 172.21.15.50:0/3026992184 >> 172.21.15.50:0/3026992184 conn(0x7f681406afa0 msgr2=0x7f6814067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 -- 172.21.15.50:0/3026992184 shutdown_connections 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.966+0000 7f68195ff700 1 -- 172.21.15.50:0/3026992184 wait complete. 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.967+0000 7f68195ff700 1 Processor -- start 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.967+0000 7f68195ff700 1 -- start start 2022-05-02T09:42:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140ad490 0x7f68140a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6814141200 0x7f681406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140a8330 con 0x7f6814141200 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68140a91f0 con 0x7f68140704b0 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68195ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68140a9860 con 0x7f68140ad490 2022-05-02T09:42:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f6812ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6814141200 0x7f681406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f6812ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50706/0 (socket says 172.21.15.50:50706) 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f6812ffd700 1 -- 172.21.15.50:0/2494321066 learned_addr learned my addr 172.21.15.50:0/2494321066 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.968+0000 7f68127fc700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140ad490 0x7f68140a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 -- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140ad490 msgr2=0x7f68140a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140ad490 0x7f68140a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 -- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6814141200 msgr2=0x7f681406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6814141200 0x7f681406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 -- 172.21.15.50:0/2494321066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040092a0 con 0x7f68140704b0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f6812ffd700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f680400ea20 tx=0x7f6804009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.969+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400ee60 con 0x7f68140704b0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.970+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400c850 con 0x7f68140704b0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.970+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68080092a0 con 0x7f68140704b0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.970+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400cbd0 con 0x7f68140704b0 2022-05-02T09:42:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.970+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681406d140 con 0x7f68140704b0 2022-05-02T09:42:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.971+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6814141df0 con 0x7f68140704b0 2022-05-02T09:42:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.971+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f6804019030 con 0x7f68140704b0 2022-05-02T09:42:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.972+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f68040598f0 con 0x7f68140704b0 2022-05-02T09:42:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:02.975+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f6804038870 con 0x7f68140704b0 2022-05-02T09:42:03.147 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.145+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f681404bfb0 con 0x7f68140704b0 2022-05-02T09:42:03.147 INFO:tasks.ceph.mon.a.smithi050.stderr:2022-05-02T09:42:03.145+0000 7f38801f4700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2022-05-02T09:42:03.363 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:03.360+0000 7f1bb5f983c0 -1 Falling back to public interface 2022-05-02T09:42:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.634+0000 7f67faffd700 1 -- 172.21.15.50:0/2494321066 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f680403be90 con 0x7f68140704b0 2022-05-02T09:42:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 >> v1:172.21.15.50:6800/36423 conn(0x7f67f4044b70 legacy=0x7f67f4047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 msgr2=0x7f6814144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f680400ea20 tx=0x7f6804009060 comp rx=0 tx=0).stop 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 shutdown_connections 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6814141200 0x7f681406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68140704b0 0x7f6814144fd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 --2- 172.21.15.50:0/2494321066 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68140ad490 0x7f68140a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 >> 172.21.15.50:0/2494321066 conn(0x7f681406afa0 msgr2=0x7f68140ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 shutdown_connections 2022-05-02T09:42:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.636+0000 7f68195ff700 1 -- 172.21.15.50:0/2494321066 wait complete. 2022-05-02T09:42:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:marked down osd.3. 2022-05-02T09:42:03.664 INFO:tasks.ceph.osd.3:Restarting daemon 2022-05-02T09:42:03.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-05-02T09:42:03.669 INFO:tasks.ceph.osd.3:Started 2022-05-02T09:42:03.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-05-02T09:42:03.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:03.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.912+0000 7faaf0bff700 1 Processor -- start 2022-05-02T09:42:03.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 -- start start 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec13e740 0x7faaec0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec0ac0b0 0x7faaec1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0a7c30 con 0x7faaec0a8a50 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0aae20 con 0x7faaec0ac0b0 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.913+0000 7faaf0bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec070830 con 0x7faaec13e740 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec0ac0b0 0x7faaec1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faaea59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec13e740 0x7faaec0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec0ac0b0 0x7faaec1411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36164/0 (socket says 172.21.15.50:36164) 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 -- 172.21.15.50:0/360283795 learned_addr learned my addr 172.21.15.50:0/360283795 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 -- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec13e740 msgr2=0x7faaec0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 --2- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec13e740 0x7faaec0702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 -- 172.21.15.50:0/360283795 >> v1:172.21.15.50:6789/0 conn(0x7faaec0a8a50 legacy=0x7faaec1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.914+0000 7faae9d9b700 1 -- 172.21.15.50:0/360283795 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec13e260 con 0x7faaec0ac0b0 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.915+0000 7faae9d9b700 1 --2- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec1411b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faae0006fd0 tx=0x7faae00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fc0050230412af server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.915+0000 7faae959a700 1 -- 172.21.15.50:0/360283795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0004030 con 0x7faaec0ac0b0 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.915+0000 7faae959a700 1 -- 172.21.15.50:0/360283795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae00041d0 con 0x7faaec0ac0b0 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.915+0000 7faae959a700 1 -- 172.21.15.50:0/360283795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0011630 con 0x7faaec0ac0b0 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 -- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 msgr2=0x7faaec1411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 --2- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec1411b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faae0006fd0 tx=0x7faae00090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 -- 172.21.15.50:0/360283795 shutdown_connections 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 --2- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec13e740 0x7faaec0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 --2- 172.21.15.50:0/360283795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec1411b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 -- 172.21.15.50:0/360283795 >> 172.21.15.50:0/360283795 conn(0x7faaec06b010 msgr2=0x7faaec067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 -- 172.21.15.50:0/360283795 shutdown_connections 2022-05-02T09:42:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.916+0000 7faaf0bff700 1 -- 172.21.15.50:0/360283795 wait complete. 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.917+0000 7faaf0bff700 1 Processor -- start 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.917+0000 7faaf0bff700 1 -- start start 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 0x7faaec0a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec141010 con 0x7faaec0ac0b0 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec13fa80 con 0x7faaec0a8a50 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.918+0000 7faaf0bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaec1408e0 con 0x7faaec13e740 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faae9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50712/0 (socket says 172.21.15.50:50712) 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 -- 172.21.15.50:0/434170522 learned_addr learned my addr 172.21.15.50:0/434170522 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaead9d700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 0x7faaec0a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 -- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 msgr2=0x7faaec0a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 0x7faaec0a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 -- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 msgr2=0x7faaec13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec13f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 -- 172.21.15.50:0/434170522 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0009370 con 0x7faaec0a8a50 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaead9d700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 0x7faaec0a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faae9d9b700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.919+0000 7faaea59c700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e930 tx=0x7faadc009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.920+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc013680 con 0x7faaec0a8a50 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.920+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc0137e0 con 0x7faaec0a8a50 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.920+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec0a6750 con 0x7faaec0a8a50 2022-05-02T09:42:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.920+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc013b80 con 0x7faaec0a8a50 2022-05-02T09:42:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.920+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec06e950 con 0x7faaec0a8a50 2022-05-02T09:42:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.921+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec0adc70 con 0x7faaec0a8a50 2022-05-02T09:42:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.921+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7faadc019030 con 0x7faaec0a8a50 2022-05-02T09:42:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.922+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3840+0+0 (secure 0 0 0) 0x7faadc059750 con 0x7faaec0a8a50 2022-05-02T09:42:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:03.926+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7faadc0385d0 con 0x7faaec0a8a50 2022-05-02T09:42:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.086+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaec04bfb0 con 0x7faaec0a8a50 2022-05-02T09:42:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.087+0000 7faada7fc700 1 -- 172.21.15.50:0/434170522 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11541 (secure 0 0 0) 0x7faadc03bdc0 con 0x7faaec0a8a50 2022-05-02T09:42:04.090 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:03.626311+0000","last_up_change":"2022-05-02T09:42:03.626311+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":30634}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":30634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":30634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":30634}]},"public_addr":"172.21.15.50:6801/30634","cluster_addr":"172.21.15.50:6802/30634","heartbeat_back_addr":"172.21.15.50:6804/30634","heartbeat_front_addr":"172.21.15.50:6803/30634","state":["exists"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 >> v1:172.21.15.50:6800/36423 conn(0x7faac8044b40 legacy=0x7faac8046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 msgr2=0x7faaec0a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e930 tx=0x7faadc009060 comp rx=0 tx=0).stop 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 shutdown_connections 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7faaec13e740 0x7faaec0a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faaec0a8a50 0x7faaec0a6e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 --2- 172.21.15.50:0/434170522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0ac0b0 0x7faaec13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.089+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 >> 172.21.15.50:0/434170522 conn(0x7faaec06b010 msgr2=0x7faaec067910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.090+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 shutdown_connections 2022-05-02T09:42:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:04.090+0000 7faaf0bff700 1 -- 172.21.15.50:0/434170522 wait complete. 2022-05-02T09:42:04.286 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.283+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2022-05-02T09:42:04.292 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.288+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.292 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.292 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.292 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.293 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.294 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:04.289+0000 7f20cfcb83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:04.372 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:04.370+0000 7f57709683c0 -1 Falling back to public interface 2022-05-02T09:42:05.178 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:05.176+0000 7f20cfcb83c0 -1 osd.0 23 log_to_monitors true 2022-05-02T09:42:05.263 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.261+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2022-05-02T09:42:05.269 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.269 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.269 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.269 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.270 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:05.271 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:05.266+0000 7f7cce2b13c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.185 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:06.182+0000 7f7cce2b13c0 -1 osd.1 24 log_to_monitors true 2022-05-02T09:42:06.341 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.338+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.349 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.350 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:06.350 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:06.346+0000 7f1bb5f983c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:07.156 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:07.154+0000 7f1bb5f983c0 -1 osd.2 25 log_to_monitors true 2022-05-02T09:42:07.160 INFO:tasks.ceph.osd.0.smithi050.stderr:2022-05-02T09:42:07.158+0000 7f20bbff2700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:42:07.315 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.313+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.320+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.320+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.326 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:07.321+0000 7f57709683c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2022-05-02T09:42:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.439+0000 7f55a43ff700 1 Processor -- start 2022-05-02T09:42:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.440+0000 7f55a43ff700 1 -- start start 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.441+0000 7f55a43ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.441+0000 7f55a43ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.441+0000 7f55a43ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0a9970 con 0x7f559c13b020 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.441+0000 7f55a43ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0a9b20 con 0x7f559c0636c0 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.441+0000 7f55a43ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c063a90 con 0x7f559c0b4c80 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.442+0000 7f55a219b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.442+0000 7f55a219b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50714/0 (socket says 172.21.15.50:50714) 2022-05-02T09:42:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.442+0000 7f55a219b700 1 -- 172.21.15.50:0/2931419847 learned_addr learned my addr 172.21.15.50:0/2931419847 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:07.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.442+0000 7f55a199a700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:07.446 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.443+0000 7f55a219b700 1 -- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 msgr2=0x7f559c13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.443+0000 7f55a219b700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c13aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.443+0000 7f55a219b700 1 -- 172.21.15.50:0/2931419847 >> v1:172.21.15.50:6789/0 conn(0x7f559c13b020 legacy=0x7f559c140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.443+0000 7f55a219b700 1 -- 172.21.15.50:0/2931419847 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0a9470 con 0x7f559c0636c0 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.444+0000 7f55a219b700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5598009860 tx=0x7f55980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cca2c88a73b07ba server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.444+0000 7f55a1199700 1 -- 172.21.15.50:0/2931419847 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598004030 con 0x7f559c0636c0 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.444+0000 7f55a1199700 1 -- 172.21.15.50:0/2931419847 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598004190 con 0x7f559c0636c0 2022-05-02T09:42:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.444+0000 7f55a1199700 1 -- 172.21.15.50:0/2931419847 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598011630 con 0x7f559c0636c0 2022-05-02T09:42:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 -- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 msgr2=0x7f559c0a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5598009860 tx=0x7f55980090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 -- 172.21.15.50:0/2931419847 shutdown_connections 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c0636c0 0x7f559c0a7ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 --2- 172.21.15.50:0/2931419847 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 -- 172.21.15.50:0/2931419847 >> 172.21.15.50:0/2931419847 conn(0x7f559c069590 msgr2=0x7f559c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.445+0000 7f55a43ff700 1 -- 172.21.15.50:0/2931419847 shutdown_connections 2022-05-02T09:42:07.449 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.446+0000 7f55a43ff700 1 -- 172.21.15.50:0/2931419847 wait complete. 2022-05-02T09:42:07.450 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.448+0000 7f55a43ff700 1 Processor -- start 2022-05-02T09:42:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.448+0000 7f55a43ff700 1 -- start start 2022-05-02T09:42:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 0x7f559c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06dab0 con 0x7f559c0636c0 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0acdb0 con 0x7f559c13b020 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a43ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c15a6f0 con 0x7f559c0b4c80 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a299c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 0x7f559c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36168/0 (socket says 172.21.15.50:36168) 2022-05-02T09:42:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a219b700 1 -- 172.21.15.50:0/3633784478 learned_addr learned my addr 172.21.15.50:0/3633784478 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.450+0000 7f55a199a700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a299c700 1 -- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 msgr2=0x7f559c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a299c700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a299c700 1 -- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 msgr2=0x7f559c0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a299c700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a299c700 1 -- 172.21.15.50:0/3633784478 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598009370 con 0x7f559c13b020 2022-05-02T09:42:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.451+0000 7f55a219b700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f55a299c700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 0x7f559c15a970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f559400c7c0 tx=0x7f5594001490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594003840 con 0x7f559c13b020 2022-05-02T09:42:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940039a0 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594003d20 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0acad0 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.452+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c06e150 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.454+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c0abb20 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.454+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f5594019030 con 0x7f559c13b020 2022-05-02T09:42:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.455+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f5594058960 con 0x7f559c13b020 2022-05-02T09:42:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.459+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f559c0abb20 con 0x7f559c13b020 2022-05-02T09:42:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.687+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f559c0abb20 con 0x7f559c13b020 2022-05-02T09:42:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.688+0000 7f558a7fc700 1 -- 172.21.15.50:0/3633784478 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+11548 (secure 0 0 0) 0x7f559c0abb20 con 0x7f559c13b020 2022-05-02T09:42:07.690 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:07.691 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:07.192057+0000","last_up_change":"2022-05-02T09:42:07.192057+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":17,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":30638}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":30638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":30638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":30638}]},"public_addr":"172.21.15.50:6809/30638","cluster_addr":"172.21.15.50:6810/30638","heartbeat_back_addr":"172.21.15.50:6812/30638","heartbeat_front_addr":"172.21.15.50:6811/30638","state":["exists"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":30635}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":30635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":30635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":30635}]},"public_addr":"172.21.15.50:6805/30635","cluster_addr":"172.21.15.50:6806/30635","heartbeat_back_addr":"172.21.15.50:6808/30635","heartbeat_front_addr":"172.21.15.50:6807/30635","state":["exists"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":30665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":30665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":30665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":30665}]},"public_addr":"172.21.15.50:6813/30665","cluster_addr":"172.21.15.50:6814/30665","heartbeat_back_addr":"172.21.15.50:6816/30665","heartbeat_front_addr":"172.21.15.50:6815/30665","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.690+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 >> v1:172.21.15.50:6800/36423 conn(0x7f557c044b40 legacy=0x7f557c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.690+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 msgr2=0x7f559c15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.690+0000 7f55a43ff700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 0x7f559c15a970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f559400c7c0 tx=0x7f5594001490 comp rx=0 tx=0).stop 2022-05-02T09:42:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 shutdown_connections 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f559c13b020 0x7f559c15a970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f559c0636c0 0x7f559c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 --2- 172.21.15.50:0/3633784478 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f559c0b4c80 0x7f559c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 >> 172.21.15.50:0/3633784478 conn(0x7f559c069590 msgr2=0x7f559c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 shutdown_connections 2022-05-02T09:42:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:07.691+0000 7f55a43ff700 1 -- 172.21.15.50:0/3633784478 wait complete. 2022-05-02T09:42:08.184 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:08.182+0000 7f57709683c0 -1 osd.3 26 log_to_monitors true 2022-05-02T09:42:09.108 INFO:tasks.ceph.osd.2.smithi050.stderr:2022-05-02T09:42:09.105+0000 7f1ba21f2700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:42:09.113 INFO:tasks.ceph.osd.1.smithi050.stderr:2022-05-02T09:42:09.110+0000 7f7cba5f2700 -1 osd.1 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:42:09.929 INFO:tasks.ceph.osd.3.smithi050.stderr:2022-05-02T09:42:09.926+0000 7f575cbf2700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-02T09:42:10.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.960+0000 7f0b927ff700 1 Processor -- start 2022-05-02T09:42:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.960+0000 7f0b927ff700 1 -- start start 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0a35d0 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0af840 con 0x7f0b8c0682a0 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b927ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0b23a0 con 0x7f0b8c068bd0 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.961+0000 7f0b8bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36170/0 (socket says 172.21.15.50:36170) 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 -- 172.21.15.50:0/3413082935 learned_addr learned my addr 172.21.15.50:0/3413082935 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50718/0 (socket says 172.21.15.50:50718) 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b90d9c700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 -- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 msgr2=0x7f0b8c1476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c1476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 -- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 msgr2=0x7f0b8c068690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8bfff700 1 -- 172.21.15.50:0/3413082935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0a3b30 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.962+0000 7f0b8b7fe700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b8bfff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c006fd0 tx=0x7f0b7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1da59bca526d51 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b8affd700 1 -- 172.21.15.50:0/3413082935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c004030 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b8affd700 1 -- 172.21.15.50:0/3413082935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c004190 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b8affd700 1 -- 172.21.15.50:0/3413082935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c011630 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 -- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0b1fd0 msgr2=0x7f0b8c0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c006fd0 tx=0x7f0b7c0090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 -- 172.21.15.50:0/3413082935 shutdown_connections 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0b1fd0 0x7f0b8c0a3090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 --2- 172.21.15.50:0/3413082935 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0682a0 0x7f0b8c068690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.963+0000 7f0b927ff700 1 -- 172.21.15.50:0/3413082935 >> 172.21.15.50:0/3413082935 conn(0x7f0b8c06ac80 msgr2=0x7f0b8c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.964+0000 7f0b927ff700 1 -- 172.21.15.50:0/3413082935 shutdown_connections 2022-05-02T09:42:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.964+0000 7f0b927ff700 1 -- 172.21.15.50:0/3413082935 wait complete. 2022-05-02T09:42:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.965+0000 7f0b927ff700 1 Processor -- start 2022-05-02T09:42:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.965+0000 7f0b927ff700 1 -- start start 2022-05-02T09:42:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0682a0 0x7f0b8c099030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 0x7f0b8c1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c098b30 con 0x7f0b8c0682a0 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0acdf0 con 0x7f0b8c0b1fd0 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.966+0000 7f0b927ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c099a10 con 0x7f0b8c068bd0 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0682a0 0x7f0b8c099030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50052/0 (socket says 172.21.15.50:50052) 2022-05-02T09:42:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 -- 172.21.15.50:0/2674503457 learned_addr learned my addr 172.21.15.50:0/2674503457 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b90d9c700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 0x7f0b8c1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 -- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 msgr2=0x7f0b8c1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 0x7f0b8c1513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 -- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0682a0 msgr2=0x7f0b8c099030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0682a0 0x7f0b8c099030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 -- 172.21.15.50:0/2674503457 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800092a0 con 0x7f0b8c068bd0 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b90d9c700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 0x7f0b8c1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.967+0000 7f0b8b7fe700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000ea00 tx=0x7f0b80009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.968+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80013680 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.968+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b800137e0 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.968+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80013b80 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.968+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c009370 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.968+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c09a720 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.969+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c04bfb0 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.969+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f0b80019030 con 0x7f0b8c068bd0 2022-05-02T09:42:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.970+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f0b800598f0 con 0x7f0b8c068bd0 2022-05-02T09:42:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:10.974+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f0b80038870 con 0x7f0b8c068bd0 2022-05-02T09:42:11.165 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.161+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b8c0ae680 con 0x7f0b8c068bd0 2022-05-02T09:42:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.162+0000 7f0b73fff700 1 -- 172.21.15.50:0/2674503457 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+11569 (secure 0 0 0) 0x7f0b8003be90 con 0x7f0b8c068bd0 2022-05-02T09:42:11.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:11.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:11.109126+0000","last_up_change":"2022-05-02T09:42:10.107171+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":38604}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":38604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":38604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":38604}]},"public_addr":"172.21.15.50:6805/38604","cluster_addr":"172.21.15.50:6806/38604","heartbeat_back_addr":"172.21.15.50:6808/38604","heartbeat_front_addr":"172.21.15.50:6807/38604","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":38708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":38708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":38708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":38708}]},"public_addr":"172.21.15.50:6809/38708","cluster_addr":"172.21.15.50:6810/38708","heartbeat_back_addr":"172.21.15.50:6812/38708","heartbeat_front_addr":"172.21.15.50:6811/38708","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":31,"up_thru":31,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":38853}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":38853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":38853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":38853}]},"public_addr":"172.21.15.50:6813/38853","cluster_addr":"172.21.15.50:6814/38853","heartbeat_back_addr":"172.21.15.50:6816/38853","heartbeat_front_addr":"172.21.15.50:6815/38853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.168+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 >> v1:172.21.15.50:6800/36423 conn(0x7f0b6c044bc0 legacy=0x7f0b6c047070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.168+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 msgr2=0x7f0b8c098160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.168+0000 7f0b927ff700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000ea00 tx=0x7f0b80009060 comp rx=0 tx=0).stop 2022-05-02T09:42:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 shutdown_connections 2022-05-02T09:42:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0b8c0b1fd0 0x7f0b8c1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b8c0682a0 0x7f0b8c099030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 --2- 172.21.15.50:0/2674503457 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f0b8c068bd0 0x7f0b8c098160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 >> 172.21.15.50:0/2674503457 conn(0x7f0b8c06ac80 msgr2=0x7f0b8c063660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 shutdown_connections 2022-05-02T09:42:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:11.172+0000 7f0b927ff700 1 -- 172.21.15.50:0/2674503457 wait complete. 2022-05-02T09:42:11.204 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-05-02T09:42:11.205 INFO:teuthology.run_tasks:Running task ceph.stop... 2022-05-02T09:42:11.216 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-05-02T09:42:11.217 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:11.237 INFO:tasks.ceph.mds.a:Stopped 2022-05-02T09:42:11.237 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-05-02T09:42:11.238 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:11.269 INFO:tasks.ceph.mds.b:Stopped 2022-05-02T09:42:11.269 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-05-02T09:42:11.269 INFO:teuthology.orchestra.run:waiting for 300 2022-05-02T09:42:11.301 INFO:tasks.ceph.mds.c:Stopped 2022-05-02T09:42:16.845 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2022-05-02T09:42:16.846 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-05-02T09:42:16.862 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2022-05-02T09:42:16.862 INFO:tasks.ceph.mds.a:Restarting daemon 2022-05-02T09:42:16.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-05-02T09:42:16.868 INFO:tasks.ceph.mds.a:Started 2022-05-02T09:42:16.868 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2022-05-02T09:42:16.868 INFO:tasks.ceph.mds.b:Restarting daemon 2022-05-02T09:42:16.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-05-02T09:42:16.873 INFO:tasks.ceph.mds.b:Started 2022-05-02T09:42:16.873 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2022-05-02T09:42:16.874 INFO:tasks.ceph.mds.c:Restarting daemon 2022-05-02T09:42:16.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-05-02T09:42:16.879 INFO:tasks.ceph.mds.c:Started 2022-05-02T09:42:16.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-05-02T09:42:16.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:17.066 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2022-05-02T09:42:17.068 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2022-05-02T09:42:17.079 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2022-05-02T09:42:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.144+0000 7f0990fff700 1 Processor -- start 2022-05-02T09:42:17.148 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.144+0000 7f0990fff700 1 -- start start 2022-05-02T09:42:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0990fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c13b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0990fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 0x7f098c148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0990fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0a9970 con 0x7f098c0636c0 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0990fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0a7f60 con 0x7f098c0a7ae0 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0990fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0a9b20 con 0x7f098c0b4c80 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f098a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f098c0636c0 0x7f098c13aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52422/0 (socket says 172.21.15.50:52422) 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f0989d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c13b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f098a59c700 1 -- 172.21.15.50:0/3972289110 learned_addr learned my addr 172.21.15.50:0/3972289110 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.145+0000 7f098ad9d700 1 --2- 172.21.15.50:0/3972289110 >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 0x7f098c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f0989d9b700 1 -- 172.21.15.50:0/3972289110 >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 msgr2=0x7f098c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f0989d9b700 1 --2- 172.21.15.50:0/3972289110 >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 0x7f098c148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f0989d9b700 1 -- 172.21.15.50:0/3972289110 >> v1:172.21.15.50:6789/0 conn(0x7f098c0636c0 legacy=0x7f098c13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f0989d9b700 1 -- 172.21.15.50:0/3972289110 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c063a90 con 0x7f098c0b4c80 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f098ad9d700 1 --2- 172.21.15.50:0/3972289110 >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 0x7f098c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f0989d9b700 1 --2- 172.21.15.50:0/3972289110 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c13b1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0980009760 tx=0x7f0980006f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f0c9ca50dd5987 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f098959a700 1 -- 172.21.15.50:0/3972289110 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980004030 con 0x7f098c0b4c80 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f098959a700 1 -- 172.21.15.50:0/3972289110 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980004190 con 0x7f098c0b4c80 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.146+0000 7f098959a700 1 -- 172.21.15.50:0/3972289110 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980005a90 con 0x7f098c0b4c80 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 -- 172.21.15.50:0/3972289110 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 msgr2=0x7f098c13b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 --2- 172.21.15.50:0/3972289110 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c13b1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0980009760 tx=0x7f0980006f40 comp rx=0 tx=0).stop 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 -- 172.21.15.50:0/3972289110 shutdown_connections 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 --2- 172.21.15.50:0/3972289110 >> v2:172.21.15.50:3300/0 conn(0x7f098c0a7ae0 0x7f098c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 --2- 172.21.15.50:0/3972289110 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c13b1f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 -- 172.21.15.50:0/3972289110 >> 172.21.15.50:0/3972289110 conn(0x7f098c069590 msgr2=0x7f098c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 -- 172.21.15.50:0/3972289110 shutdown_connections 2022-05-02T09:42:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.147+0000 7f0990fff700 1 -- 172.21.15.50:0/3972289110 wait complete. 2022-05-02T09:42:17.155 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.149+0000 7f0990fff700 1 Processor -- start 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.149+0000 7f0990fff700 1 -- start start 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f098c0a7ae0 0x7f098c096a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b1290 con 0x7f098c0636c0 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b00a0 con 0x7f098c0a7ae0 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0990fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098c096fc0 con 0x7f098c0b4c80 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f098a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f0989d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f098c0a7ae0 0x7f098c096a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.156 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f098ad9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f098a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36180/0 (socket says 172.21.15.50:36180) 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.150+0000 7f098a59c700 1 -- 172.21.15.50:0/3701588865 learned_addr learned my addr 172.21.15.50:0/3701588865 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 -- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 msgr2=0x7f098c0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 -- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f098c0a7ae0 msgr2=0x7f098c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f098c0a7ae0 0x7f098c096a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 -- 172.21.15.50:0/3701588865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009a20 con 0x7f098c0636c0 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f098a59c700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0072e0 con 0x7f098c0636c0 2022-05-02T09:42:17.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c007440 con 0x7f098c0636c0 2022-05-02T09:42:17.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c005780 con 0x7f098c0636c0 2022-05-02T09:42:17.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.151+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0980009250 con 0x7f098c0636c0 2022-05-02T09:42:17.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.152+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c151160 con 0x7f098c0636c0 2022-05-02T09:42:17.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.153+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c1515c0 con 0x7f098c0636c0 2022-05-02T09:42:17.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.153+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f097c019030 con 0x7f098c0636c0 2022-05-02T09:42:17.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.154+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f097c058920 con 0x7f098c0636c0 2022-05-02T09:42:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.158+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f097c037a00 con 0x7f098c0636c0 2022-05-02T09:42:17.197 INFO:tasks.ceph.mon.a.smithi050.stderr:2022-05-02T09:42:17.193+0000 7f38829f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-05-02T09:42:17.334 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.330+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f098c04bfb0 con 0x7f098c0636c0 2022-05-02T09:42:17.335 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.331+0000 7f097a7fc700 1 -- 172.21.15.50:0/3701588865 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+11634 (secure 0 0 0) 0x7f097c017030 con 0x7f098c0636c0 2022-05-02T09:42:17.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:17.335 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:17.093987+0000","last_up_change":"2022-05-02T09:42:10.107171+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":38604}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":38604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":38604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":38604}]},"public_addr":"172.21.15.50:6805/38604","cluster_addr":"172.21.15.50:6806/38604","heartbeat_back_addr":"172.21.15.50:6808/38604","heartbeat_front_addr":"172.21.15.50:6807/38604","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":38708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":38708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":38708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":38708}]},"public_addr":"172.21.15.50:6809/38708","cluster_addr":"172.21.15.50:6810/38708","heartbeat_back_addr":"172.21.15.50:6812/38708","heartbeat_front_addr":"172.21.15.50:6811/38708","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":31,"up_thru":31,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":38853}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":38853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":38853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":38853}]},"public_addr":"172.21.15.50:6813/38853","cluster_addr":"172.21.15.50:6814/38853","heartbeat_back_addr":"172.21.15.50:6816/38853","heartbeat_front_addr":"172.21.15.50:6815/38853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6819/3706979787":"2022-05-03T09:42:17.093955+0000","172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:17.337 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 >> v1:172.21.15.50:6800/36423 conn(0x7f0968044b40 legacy=0x7f0968046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.337 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 msgr2=0x7f098c151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c007df0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 shutdown_connections 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f098c0b4c80 0x7f098c0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f098c0636c0 0x7f098c151770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 --2- 172.21.15.50:0/3701588865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f098c0a7ae0 0x7f098c096a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 >> 172.21.15.50:0/3701588865 conn(0x7f098c069590 msgr2=0x7f098c0b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 shutdown_connections 2022-05-02T09:42:17.338 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.333+0000 7f0990fff700 1 -- 172.21.15.50:0/3701588865 wait complete. 2022-05-02T09:42:17.363 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-05-02T09:42:17.363 INFO:teuthology.run_tasks:Running task exec... 2022-05-02T09:42:17.374 INFO:teuthology.task.exec:Executing custom commands... 2022-05-02T09:42:17.374 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2022-05-02T09:42:17.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2022-05-02T09:42:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.583+0000 7fcc6359e700 1 Processor -- start 2022-05-02T09:42:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.583+0000 7fcc6359e700 1 -- start start 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc640638b0 0x7fcc6413dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 0x7fcc64141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6413d920 con 0x7fcc640638b0 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc64063c80 con 0x7fcc6413e290 2022-05-02T09:42:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6359e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640a9130 con 0x7fcc640a9b10 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc640638b0 0x7fcc6413dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 0x7fcc64141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc62d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc640638b0 0x7fcc6413dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36182/0 (socket says 172.21.15.50:36182) 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 0x7fcc64141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50728/0 (socket says 172.21.15.50:50728) 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc6259c700 1 -- 172.21.15.50:0/1909605008 learned_addr learned my addr 172.21.15.50:0/1909605008 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.584+0000 7fcc62d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 -- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 msgr2=0x7fcc640a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 -- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 msgr2=0x7fcc64141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 0x7fcc64141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 -- 172.21.15.50:0/1909605008 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6413e720 con 0x7fcc640638b0 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc62d9d700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.585+0000 7fcc6259c700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc640638b0 0x7fcc6413dd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8f1645e5e9db6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6159a700 1 -- 172.21.15.50:0/1909605008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54004030 con 0x7fcc640638b0 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6159a700 1 -- 172.21.15.50:0/1909605008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54004190 con 0x7fcc640638b0 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6159a700 1 -- 172.21.15.50:0/1909605008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54011630 con 0x7fcc640638b0 2022-05-02T09:42:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 -- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc640638b0 msgr2=0x7fcc6413dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc640638b0 0x7fcc6413dd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc540090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 -- 172.21.15.50:0/1909605008 shutdown_connections 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640a9b10 0x7fcc640a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc640638b0 0x7fcc6413dd50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 --2- 172.21.15.50:0/1909605008 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc6413e290 0x7fcc64141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 -- 172.21.15.50:0/1909605008 >> 172.21.15.50:0/1909605008 conn(0x7fcc640676c0 msgr2=0x7fcc64062fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 -- 172.21.15.50:0/1909605008 shutdown_connections 2022-05-02T09:42:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.586+0000 7fcc6359e700 1 -- 172.21.15.50:0/1909605008 wait complete. 2022-05-02T09:42:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.589+0000 7fcc6359e700 1 Processor -- start 2022-05-02T09:42:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.589+0000 7fcc6359e700 1 -- start start 2022-05-02T09:42:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640638b0 0x7fcc64096ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 0x7fcc64151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc64097720 con 0x7fcc6413e290 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc64097920 con 0x7fcc640a9b10 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6359e700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640981d0 con 0x7fcc640638b0 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640638b0 0x7fcc64096ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50730/0 (socket says 172.21.15.50:50730) 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc62d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 0x7fcc64151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.590+0000 7fcc61d9b700 1 -- 172.21.15.50:0/3868599607 learned_addr learned my addr 172.21.15.50:0/3868599607 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 -- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640638b0 msgr2=0x7fcc64096ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640638b0 0x7fcc64096ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 -- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 msgr2=0x7fcc64151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 0x7fcc64151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 -- 172.21.15.50:0/3868599607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c009a20 con 0x7fcc640a9b10 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc62d9d700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 0x7fcc64151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc61d9b700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e930 tx=0x7fcc58009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.591+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58013680 con 0x7fcc640a9b10 2022-05-02T09:42:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.592+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc580137e0 con 0x7fcc640a9b10 2022-05-02T09:42:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.592+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc54009370 con 0x7fcc640a9b10 2022-05-02T09:42:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.592+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58013b80 con 0x7fcc640a9b10 2022-05-02T09:42:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.592+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc640b0f80 con 0x7fcc640a9b10 2022-05-02T09:42:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.593+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6405ee50 con 0x7fcc640a9b10 2022-05-02T09:42:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.593+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fcc58019030 con 0x7fcc640a9b10 2022-05-02T09:42:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.594+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fcc580595e0 con 0x7fcc640a9b10 2022-05-02T09:42:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.598+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fcc580384f0 con 0x7fcc640a9b10 2022-05-02T09:42:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.810+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc64140ed0 con 0x7fcc640a9b10 2022-05-02T09:42:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.811+0000 7fcc527fc700 1 -- 172.21.15.50:0/3868599607 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fcc5803bce0 con 0x7fcc640a9b10 2022-05-02T09:42:17.814 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:42:17.814 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev)": 3 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev)": 2 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev)": 4 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2022-05-02T09:42:17.815 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev)": 3 2022-05-02T09:42:17.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:17.816 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2022-05-02T09:42:17.816 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev)": 12 2022-05-02T09:42:17.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:17.816 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:42:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 >> v1:172.21.15.50:6800/36423 conn(0x7fcc40044b40 legacy=0x7fcc40046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 msgr2=0x7fcc640b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e930 tx=0x7fcc58009060 comp rx=0 tx=0).stop 2022-05-02T09:42:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 shutdown_connections 2022-05-02T09:42:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fcc640638b0 0x7fcc64096ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc6413e290 0x7fcc64151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 --2- 172.21.15.50:0/3868599607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcc640a9b10 0x7fcc640b0290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 >> 172.21.15.50:0/3868599607 conn(0x7fcc640676c0 msgr2=0x7fcc640b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 shutdown_connections 2022-05-02T09:42:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:17.813+0000 7fcc6359e700 1 -- 172.21.15.50:0/3868599607 wait complete. 2022-05-02T09:42:17.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2022-05-02T09:42:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.050+0000 7f85231ff700 1 Processor -- start 2022-05-02T09:42:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.050+0000 7f85231ff700 1 -- start start 2022-05-02T09:42:18.057 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.051+0000 7f85231ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 0x7f851c13e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.057 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.051+0000 7f85231ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.057 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.051+0000 7f85231ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c0a35f0 con 0x7f851c0a2100 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.051+0000 7f85231ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0a2940 con 0x7f851c0a3220 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.051+0000 7f85231ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c13eaa0 con 0x7f851c13db10 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f8520f9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 0x7f851c13e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50734/0 (socket says 172.21.15.50:50734) 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 -- 172.21.15.50:0/2715486490 learned_addr learned my addr 172.21.15.50:0/2715486490 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f852179c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f851c0a2100 0x7f851c1410a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52424/0 (socket says 172.21.15.50:52424) 2022-05-02T09:42:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 -- 172.21.15.50:0/2715486490 >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 msgr2=0x7f851c13e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 --2- 172.21.15.50:0/2715486490 >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 0x7f851c13e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 -- 172.21.15.50:0/2715486490 >> v1:172.21.15.50:6789/0 conn(0x7f851c0a2100 legacy=0x7f851c1410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f851bfff700 1 -- 172.21.15.50:0/2715486490 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0a1050 con 0x7f851c13db10 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.052+0000 7f8520f9b700 1 --2- 172.21.15.50:0/2715486490 >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 0x7f851c13e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f851bfff700 1 --2- 172.21.15.50:0/2715486490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8508006fd0 tx=0x7f85080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=692eafa8cb63b457 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f851b7fe700 1 -- 172.21.15.50:0/2715486490 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508004030 con 0x7f851c13db10 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f851b7fe700 1 -- 172.21.15.50:0/2715486490 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85080041d0 con 0x7f851c13db10 2022-05-02T09:42:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f851b7fe700 1 -- 172.21.15.50:0/2715486490 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508011630 con 0x7f851c13db10 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 -- 172.21.15.50:0/2715486490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 msgr2=0x7f851c0a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 --2- 172.21.15.50:0/2715486490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8508006fd0 tx=0x7f85080090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 -- 172.21.15.50:0/2715486490 shutdown_connections 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 --2- 172.21.15.50:0/2715486490 >> v2:172.21.15.50:3300/0 conn(0x7f851c0a3220 0x7f851c13e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 --2- 172.21.15.50:0/2715486490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c13db10 0x7f851c0a1bc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.053+0000 7f85231ff700 1 -- 172.21.15.50:0/2715486490 >> 172.21.15.50:0/2715486490 conn(0x7f851c0b40a0 msgr2=0x7f851c0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.054+0000 7f85231ff700 1 -- 172.21.15.50:0/2715486490 shutdown_connections 2022-05-02T09:42:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.054+0000 7f85231ff700 1 -- 172.21.15.50:0/2715486490 wait complete. 2022-05-02T09:42:18.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.055+0000 7f85231ff700 1 Processor -- start 2022-05-02T09:42:18.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.055+0000 7f85231ff700 1 -- start start 2022-05-02T09:42:18.063 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c0a3220 0x7f851c0aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c13db10 0x7f851c0a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0ab610 con 0x7f851c13db10 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0aadb0 con 0x7f851c0a3220 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f85231ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0aaf20 con 0x7f851c0a2100 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f8520f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f8520f9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50070/0 (socket says 172.21.15.50:50070) 2022-05-02T09:42:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f8520f9b700 1 -- 172.21.15.50:0/3466544048 learned_addr learned my addr 172.21.15.50:0/3466544048 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f851bfff700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c0a3220 0x7f851c0aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.056+0000 7f852179c700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c13db10 0x7f851c0a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 -- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c0a3220 msgr2=0x7f851c0aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c0a3220 0x7f851c0aa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 -- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c13db10 msgr2=0x7f851c0a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c13db10 0x7f851c0a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 -- 172.21.15.50:0/3466544048 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100092a0 con 0x7f851c0a2100 2022-05-02T09:42:18.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8520f9b700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f851000ea20 tx=0x7f8510009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510009600 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000c850 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.057+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8508009370 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.058+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000cbf0 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.058+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0a9590 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.059+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c04bfb0 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.059+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f8510019030 con 0x7f851c0a2100 2022-05-02T09:42:18.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.060+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f85100597a0 con 0x7f851c0a2100 2022-05-02T09:42:18.067 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.064+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f85100387c0 con 0x7f851c0a2100 2022-05-02T09:42:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.226+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f851c04b770 con 0x7f851c0a2100 2022-05-02T09:42:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.227+0000 7f8518ff9700 1 -- 172.21.15.50:0/3466544048 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+21156 (secure 0 0 0) 0x7f851003bde0 con 0x7f851c0a2100 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 35, 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "7c52b71c-589c-4ac2-936d-4a721101e437", 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2022-05-02T09:38:47.780270+0000", 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2022-05-02T09:42:17.093987+0000", 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2022-05-02T09:42:10.107171+0000", 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2022-05-02T09:38:55.533250+0000", 2022-05-02T09:42:18.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 7, 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-05-02T09:42:18.232 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 4, 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 4, 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "octopus", 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "octopus", 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2022-05-02T09:42:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2022-05-02T09:38:50.430034+0000", 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2022-05-02T09:42:18.234 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-05-02T09:42:18.235 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2022-05-02T09:42:18.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2022-05-02T09:42:18.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2022-05-02T09:42:18.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2022-05-02T09:42:18.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2022-05-02T09:42:18.236 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "23", 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2022-05-02T09:42:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2022-05-02T09:42:18.238 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2022-05-02T09:42:18.239 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2022-05-02T09:42:18.240 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {}, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_devicehealth": {} 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2022-05-02T09:38:59.234105+0000", 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2022-05-02T09:42:18.242 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2022-05-02T09:42:18.243 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "15", 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2022-05-02T09:42:18.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2022-05-02T09:42:18.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2022-05-02T09:42:18.246 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2022-05-02T09:42:18.247 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2022-05-02T09:39:08.938842+0000", 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2022-05-02T09:42:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2022-05-02T09:42:18.250 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2022-05-02T09:42:18.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2022-05-02T09:42:18.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2022-05-02T09:42:18.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2022-05-02T09:42:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2022-05-02T09:42:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 4, 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2022-05-02T09:39:10.323546+0000", 2022-05-02T09:42:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-05-02T09:42:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2022-05-02T09:42:18.258 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "19", 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2022-05-02T09:42:18.259 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2022-05-02T09:42:18.260 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2022-05-02T09:42:18.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2022-05-02T09:42:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.263 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2022-05-02T09:42:18.264 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5052e124-3372-47ca-82bf-129e055505ff", 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 10, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 23, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 29, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 31, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 24, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2022-05-02T09:42:18.265 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38513 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2022-05-02T09:42:18.266 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38513 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38513 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2022-05-02T09:42:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38513 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/38513", 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6802/38513", 2022-05-02T09:42:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6804/38513", 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6803/38513", 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "977ab153-0005-4d17-87fd-513b8e54c8a5", 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2022-05-02T09:42:18.270 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 10, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 24, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 31, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 31, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 25, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2022-05-02T09:42:18.271 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38604 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38604 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.273 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38604 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2022-05-02T09:42:18.274 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38604 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6805/38604", 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6806/38604", 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6808/38604", 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6807/38604", 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2022-05-02T09:42:18.275 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "967bcdc5-8577-484e-bdd1-09a1ccdcad37", 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 10, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 25, 2022-05-02T09:42:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 31, 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 31, 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 26, 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38708 2022-05-02T09:42:18.277 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38708 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38708 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38708 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/38708", 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6810/38708", 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6812/38708", 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6811/38708", 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "14b35f6e-2868-4cbd-81c5-d6cb8807774f", 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 10, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 26, 2022-05-02T09:42:18.282 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 31, 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 31, 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 27, 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38853 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.283 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38853 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38853 2022-05-02T09:42:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 38853 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6813/38853", 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6814/38853", 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6816/38853", 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6815/38853", 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.287 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138320759226367, 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2022-05-02T09:38:53.651875+0000", 2022-05-02T09:42:18.288 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 24 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138320759226367, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2022-05-02T09:38:53.700108+0000", 2022-05-02T09:42:18.289 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 25 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138320759226367, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2022-05-02T09:38:53.881733+0000", 2022-05-02T09:42:18.290 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 26 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "2022-05-02T09:42:03.626311+0000", 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138320759226367, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2022-05-02T09:38:53.655162+0000", 2022-05-02T09:42:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": { 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "172.21.15.50:6819/3706979787": "2022-05-03T09:42:17.093955+0000", 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "172.21.15.50:0/1390228452": "2022-05-03T09:41:50.599109+0000", 2022-05-02T09:42:18.292 INFO:teuthology.orchestra.run.smithi050.stdout: "172.21.15.50:0/59626694": "2022-05-03T09:41:50.599109+0000", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "172.21.15.50:0/4112136070": "2022-05-03T09:41:50.599109+0000", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "172.21.15.50:6800/30011": "2022-05-03T09:41:50.599109+0000" 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2022-05-02T09:42:18.293 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2022-05-02T09:42:18.294 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2022-05-02T09:42:18.295 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2022-05-02T09:42:18.295 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2022-05-02T09:42:18.295 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2022-05-02T09:42:18.295 INFO:teuthology.orchestra.run.smithi050.stdout: } 2022-05-02T09:42:18.295 INFO:teuthology.orchestra.run.smithi050.stdout:} 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.228+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 >> v1:172.21.15.50:6800/36423 conn(0x7f8504044b40 legacy=0x7f8504046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.228+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 msgr2=0x7f851c0abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.228+0000 7f85231ff700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f851000ea20 tx=0x7f8510009060 comp rx=0 tx=0).stop 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 shutdown_connections 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f851c0a2100 0x7f851c0abcf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c13db10 0x7f851c0a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 --2- 172.21.15.50:0/3466544048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c0a3220 0x7f851c0aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 >> 172.21.15.50:0/3466544048 conn(0x7f851c0b40a0 msgr2=0x7f851c064280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 shutdown_connections 2022-05-02T09:42:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.229+0000 7f85231ff700 1 -- 172.21.15.50:0/3466544048 wait complete. 2022-05-02T09:42:18.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy' 2022-05-02T09:42:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.510+0000 7f930499d700 1 Processor -- start 2022-05-02T09:42:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.510+0000 7f930499d700 1 -- start start 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f930499d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f930013e000 0x7f930013e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f930499d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9300146340 0x7f9300148720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f930499d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93000b46d0 con 0x7f93000a9830 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f930499d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930013dd60 con 0x7f930013e000 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f930499d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000a7b90 con 0x7f9300146340 2022-05-02T09:42:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f92ff7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93000a9830 0x7f93000a85f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52426/0 (socket says 172.21.15.50:52426) 2022-05-02T09:42:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f92ff7fe700 1 -- 172.21.15.50:0/4161210014 learned_addr learned my addr 172.21.15.50:0/4161210014 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.511+0000 7f92feffd700 1 --2- 172.21.15.50:0/4161210014 >> v2:172.21.15.50:3300/0 conn(0x7f930013e000 0x7f930013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92fffff700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9300146340 0x7f9300148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92fe7fc700 1 -- 172.21.15.50:0/4161210014 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819206714 0 0) 0x7f93000b46d0 con 0x7f93000a9830 2022-05-02T09:42:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92feffd700 1 -- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9300146340 msgr2=0x7f9300148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92feffd700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9300146340 0x7f9300148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92feffd700 1 -- 172.21.15.50:0/4161210014 >> v1:172.21.15.50:6789/0 conn(0x7f93000a9830 legacy=0x7f93000a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92feffd700 1 -- 172.21.15.50:0/4161210014 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930013e960 con 0x7f930013e000 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.512+0000 7f92feffd700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930013e000 0x7f930013e420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009760 tx=0x7f92f4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3417df7dc644cd28 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f92fe7fc700 1 -- 172.21.15.50:0/4161210014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4011630 con 0x7f930013e000 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f92fe7fc700 1 -- 172.21.15.50:0/4161210014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4011790 con 0x7f930013e000 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f92fe7fc700 1 -- 172.21.15.50:0/4161210014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4011b50 con 0x7f930013e000 2022-05-02T09:42:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 -- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930013e000 msgr2=0x7f930013e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930013e000 0x7f930013e420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009760 tx=0x7f92f4009060 comp rx=0 tx=0).stop 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 -- 172.21.15.50:0/4161210014 shutdown_connections 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9300146340 0x7f9300148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 --2- 172.21.15.50:0/4161210014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930013e000 0x7f930013e420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 -- 172.21.15.50:0/4161210014 >> 172.21.15.50:0/4161210014 conn(0x7f93000698c0 msgr2=0x7f9300067400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 -- 172.21.15.50:0/4161210014 shutdown_connections 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.513+0000 7f930499d700 1 -- 172.21.15.50:0/4161210014 wait complete. 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.515+0000 7f930499d700 1 Processor -- start 2022-05-02T09:42:18.521 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.515+0000 7f930499d700 1 -- start start 2022-05-02T09:42:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 0x7f93000addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 0x7f93000abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 0x7f9300150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000ad780 con 0x7f9300146340 2022-05-02T09:42:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000b14f0 con 0x7f930013e000 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f930499d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9300140820 con 0x7f93000a9830 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 0x7f93000addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f92fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 0x7f9300150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f92feffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 0x7f93000abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 0x7f93000addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50072/0 (socket says 172.21.15.50:50072) 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.516+0000 7f92ff7fe700 1 -- 172.21.15.50:0/2229109905 learned_addr learned my addr 172.21.15.50:0/2229109905 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 -- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 msgr2=0x7f93000addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 0x7f93000addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 -- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 msgr2=0x7f93000abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 0x7f93000abcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 -- 172.21.15.50:0/2229109905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40092a0 con 0x7f9300146340 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92feffd700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 0x7f93000abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92fffff700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 0x7f9300150c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92f800ec90 tx=0x7f92f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800c890 con 0x7f9300146340 2022-05-02T09:42:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f800f040 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800cc60 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.517+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93000aa800 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.518+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93000ac3b0 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.519+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000b4710 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.519+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f92f8014690 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.520+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f92f805a460 con 0x7f9300146340 2022-05-02T09:42:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.523+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f92f80392b0 con 0x7f9300146340 2022-05-02T09:42:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:18.693+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f93000aa200 con 0x7f9300146340 2022-05-02T09:42:19.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.218+0000 7f92e77fe700 1 -- 172.21.15.50:0/2229109905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0 v36) v1 ==== 92+0+0 (secure 0 0 0) 0x7f92f8018030 con 0x7f9300146340 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 >> v1:172.21.15.50:6800/36423 conn(0x7f92e0044b70 legacy=0x7f92e0047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 msgr2=0x7f9300150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 0x7f9300150c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92f800ec90 tx=0x7f92f800b040 comp rx=0 tx=0).stop 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 shutdown_connections 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f93000a9830 0x7f93000addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9300146340 0x7f9300150c80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 --2- 172.21.15.50:0/2229109905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f930013e000 0x7f93000abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 >> 172.21.15.50:0/2229109905 conn(0x7f93000698c0 msgr2=0x7f93000a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 shutdown_connections 2022-05-02T09:42:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.223+0000 7f930499d700 1 -- 172.21.15.50:0/2229109905 wait complete. 2022-05-02T09:42:19.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2022-05-02T09:42:19.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.465+0000 7f75013ff700 1 Processor -- start 2022-05-02T09:42:19.469 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.465+0000 7f75013ff700 1 -- start start 2022-05-02T09:42:19.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.466+0000 7f75013ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74fc06f070 0x7f74fc06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.466+0000 7f75013ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 0x7f74fc141da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.466+0000 7f75013ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc06dc60 con 0x7f74fc06d890 2022-05-02T09:42:19.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.466+0000 7f75013ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0a3d20 con 0x7f74fc06f070 2022-05-02T09:42:19.471 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.466+0000 7f75013ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0683d0 con 0x7f74fc141920 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74fc06f070 0x7f74fc06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 0x7f74fc141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74fc06f070 0x7f74fc06f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36194/0 (socket says 172.21.15.50:36194) 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 0x7f74fc141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50742/0 (socket says 172.21.15.50:50742) 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74faffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74fc06d890 0x7f74fc06e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52428/0 (socket says 172.21.15.50:52428) 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2753512469 learned_addr learned my addr 172.21.15.50:0/2753512469 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 msgr2=0x7f74fc141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 --2- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 0x7f74fc141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2753512469 >> v1:172.21.15.50:6789/0 conn(0x7f74fc06d890 legacy=0x7f74fc06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2753512469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc068630 con 0x7f74fc06f070 2022-05-02T09:42:19.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.467+0000 7f74fa7fc700 1 --2- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06f070 0x7f74fc06f460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009810 tx=0x7f74f0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718d9e4a4af19dc2 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:19.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f74f9ffb700 1 -- 172.21.15.50:0/2753512469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0005a90 con 0x7f74fc06f070 2022-05-02T09:42:19.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f74f9ffb700 1 -- 172.21.15.50:0/2753512469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0005bf0 con 0x7f74fc06f070 2022-05-02T09:42:19.473 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f74f9ffb700 1 -- 172.21.15.50:0/2753512469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0006030 con 0x7f74fc06f070 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 -- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06f070 msgr2=0x7f74fc06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 --2- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06f070 0x7f74fc06f460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009810 tx=0x7f74f0009060 comp rx=0 tx=0).stop 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 -- 172.21.15.50:0/2753512469 shutdown_connections 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 --2- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc141920 0x7f74fc141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 --2- 172.21.15.50:0/2753512469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06f070 0x7f74fc06f460 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.468+0000 7f75013ff700 1 -- 172.21.15.50:0/2753512469 >> 172.21.15.50:0/2753512469 conn(0x7f74fc062fe0 msgr2=0x7f74fc0633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.469+0000 7f75013ff700 1 -- 172.21.15.50:0/2753512469 shutdown_connections 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.469+0000 7f75013ff700 1 -- 172.21.15.50:0/2753512469 wait complete. 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.470+0000 7f75013ff700 1 Processor -- start 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.470+0000 7f75013ff700 1 -- start start 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 0x7f74fc142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f74fc141920 0x7f74fc13ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc098400 con 0x7f74fc06d890 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc099590 con 0x7f74fc06f070 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f75013ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0969e0 con 0x7f74fc141920 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f74fa7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f74faffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 0x7f74fc142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f74fa7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50744/0 (socket says 172.21.15.50:50744) 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2185170243 learned_addr learned my addr 172.21.15.50:0/2185170243 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.471+0000 7f74fb7fe700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f74fc141920 0x7f74fc13ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f74fc141920 msgr2=0x7f74fc13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f74fc141920 0x7f74fc13ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 msgr2=0x7f74fc142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 0x7f74fc142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 -- 172.21.15.50:0/2185170243 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0009300 con 0x7f74fc06f070 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74faffd700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 0x7f74fc142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74fa7fc700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009eb0 tx=0x7f74f0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f001b690 con 0x7f74fc06f070 2022-05-02T09:42:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f001b7f0 con 0x7f74fc06f070 2022-05-02T09:42:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f001bb90 con 0x7f74fc06f070 2022-05-02T09:42:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.472+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc096c80 con 0x7f74fc06f070 2022-05-02T09:42:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.473+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc098650 con 0x7f74fc06f070 2022-05-02T09:42:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.474+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc04bfb0 con 0x7f74fc06f070 2022-05-02T09:42:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.474+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f74f002c020 con 0x7f74fc06f070 2022-05-02T09:42:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.475+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f74f005b500 con 0x7f74fc06f070 2022-05-02T09:42:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.478+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f74f0003de0 con 0x7f74fc06f070 2022-05-02T09:42:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.635+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f74fc0a39c0 con 0x7f74fc06f070 2022-05-02T09:42:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.636+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2185170243 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v36) v1 ==== 59+0+37 (secure 0 0 0) 0x7f74f0045080 con 0x7f74fc06f070 2022-05-02T09:42:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 >> v1:172.21.15.50:6800/36423 conn(0x7f74dc044b40 legacy=0x7f74dc046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 msgr2=0x7f74fc099050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009eb0 tx=0x7f74f0016000 comp rx=0 tx=0).stop 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 shutdown_connections 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f74fc141920 0x7f74fc13ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc06d890 0x7f74fc142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 --2- 172.21.15.50:0/2185170243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f74fc06f070 0x7f74fc099050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 >> 172.21.15.50:0/2185170243 conn(0x7f74fc062fe0 msgr2=0x7f74fc06e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 shutdown_connections 2022-05-02T09:42:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.638+0000 7f75013ff700 1 -- 172.21.15.50:0/2185170243 wait complete. 2022-05-02T09:42:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.792+0000 7f304abff700 1 Processor -- start 2022-05-02T09:42:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.792+0000 7f304abff700 1 -- start start 2022-05-02T09:42:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304abff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30440638b0 0x7f30440af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304abff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 0x7f304406e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304abff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440686c0 con 0x7f304406ec00 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304abff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440b15d0 con 0x7f30440638b0 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304abff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3044063c80 con 0x7f3044069ef0 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.793+0000 7f304899b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30440638b0 0x7f30440af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f3043fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 0x7f304406e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30440638b0 0x7f30440af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36198/0 (socket says 172.21.15.50:36198) 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304919c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f304406ec00 0x7f3044141660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52430/0 (socket says 172.21.15.50:52430) 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 -- 172.21.15.50:0/3593629630 learned_addr learned my addr 172.21.15.50:0/3593629630 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 -- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 msgr2=0x7f304406e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 0x7f304406e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 -- 172.21.15.50:0/3593629630 >> v1:172.21.15.50:6789/0 conn(0x7f304406ec00 legacy=0x7f3044141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 -- 172.21.15.50:0/3593629630 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440af5c0 con 0x7f30440638b0 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f3043fff700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 0x7f304406e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.794+0000 7f304899b700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30440638b0 0x7f30440af080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3038006fd0 tx=0x7f30380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355f963157a224a server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f30437fe700 1 -- 172.21.15.50:0/3593629630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038004030 con 0x7f30440638b0 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f30437fe700 1 -- 172.21.15.50:0/3593629630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380041d0 con 0x7f30440638b0 2022-05-02T09:42:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f30437fe700 1 -- 172.21.15.50:0/3593629630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038011630 con 0x7f30440638b0 2022-05-02T09:42:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 -- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30440638b0 msgr2=0x7f30440af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30440638b0 0x7f30440af080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3038006fd0 tx=0x7f30380090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 -- 172.21.15.50:0/3593629630 shutdown_connections 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30440638b0 0x7f30440af080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 --2- 172.21.15.50:0/3593629630 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f3044069ef0 0x7f304406e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.795+0000 7f304abff700 1 -- 172.21.15.50:0/3593629630 >> 172.21.15.50:0/3593629630 conn(0x7f304406ca20 msgr2=0x7f3044062fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.796+0000 7f304abff700 1 -- 172.21.15.50:0/3593629630 shutdown_connections 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.796+0000 7f304abff700 1 -- 172.21.15.50:0/3593629630 wait complete. 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.797+0000 7f304abff700 1 Processor -- start 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.797+0000 7f304abff700 1 -- start start 2022-05-02T09:42:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f304406ec00 0x7f3044150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304409d100 con 0x7f3044069ef0 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304409b270 con 0x7f304406ec00 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304abff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3044097df0 con 0x7f30440638b0 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304899b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f3043fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304899b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50078/0 (socket says 172.21.15.50:50078) 2022-05-02T09:42:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f3043fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36202/0 (socket says 172.21.15.50:36202) 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304899b700 1 -- 172.21.15.50:0/2392531947 learned_addr learned my addr 172.21.15.50:0/2392531947 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.798+0000 7f304919c700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f304406ec00 0x7f3044150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 -- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f304406ec00 msgr2=0x7f3044150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f304406ec00 0x7f3044150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 -- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 msgr2=0x7f304409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 -- 172.21.15.50:0/2392531947 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300092a0 con 0x7f30440638b0 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f3043fff700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304899b700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3038008000 tx=0x7f3038016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380036f0 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038003870 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038003c30 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.799+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038009370 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.800+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304409a630 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.801+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3044067220 con 0x7f30440638b0 2022-05-02T09:42:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.801+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f3038017020 con 0x7f30440638b0 2022-05-02T09:42:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.802+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f303805b1a0 con 0x7f30440638b0 2022-05-02T09:42:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.805+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f3038026c10 con 0x7f30440638b0 2022-05-02T09:42:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:19.964+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f304404b770 con 0x7f30440638b0 2022-05-02T09:42:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.223+0000 7f3040ff9700 1 -- 172.21.15.50:0/2392531947 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v37) v1 ==== 153+0+0 (secure 0 0 0) 0x7f303802a030 con 0x7f30440638b0 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.226+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 >> v1:172.21.15.50:6800/36423 conn(0x7f302c044b40 legacy=0x7f302c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.226+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 msgr2=0x7f304409bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.226+0000 7f304abff700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3038008000 tx=0x7f3038016000 comp rx=0 tx=0).stop 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.226+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 shutdown_connections 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.226+0000 7f304abff700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f30440638b0 0x7f304409bc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.227+0000 7f304abff700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f304406ec00 0x7f3044150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.227+0000 7f304abff700 1 --2- 172.21.15.50:0/2392531947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3044069ef0 0x7f304409a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.227+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 >> 172.21.15.50:0/2392531947 conn(0x7f304406ca20 msgr2=0x7f30440b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.227+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 shutdown_connections 2022-05-02T09:42:20.231 INFO:tasks.ceph.mds.c.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fdf979ed700 time 2022-05-02T09:42:20.229363+0000 2022-05-02T09:42:20.232 INFO:tasks.ceph.mds.c.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:20.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.227+0000 7f304abff700 1 -- 172.21.15.50:0/2392531947 wait complete. 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7fdfa7285114] 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.233 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.234 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: clone() 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr:2022-05-02T09:42:20.229+0000 7fdf979ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fdf979ed700 time 2022-05-02T09:42:20.229363+0000 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7fdfa7285114] 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.235 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.236 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: clone() 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr:*** Caught signal (Aborted) ** 2022-05-02T09:42:20.237 INFO:tasks.ceph.mds.c.smithi050.stderr: in thread 7fdf979ed700 thread_name:mds_rank_progr 2022-05-02T09:42:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 1 pg_autoscale_mode to off 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdfa5a12ce0] 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: abort() 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7fdfa7285172] 2022-05-02T09:42:20.239 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.240 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 16: clone() 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr:2022-05-02T09:42:20.231+0000 7fdf979ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: in thread 7fdf979ed700 thread_name:mds_rank_progr 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdfa5a12ce0] 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:20.241 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: abort() 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7fdfa7285172] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.242 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 16: clone() 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: -1> 2022-05-02T09:42:20.229+0000 7fdf979ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fdf979ed700 time 2022-05-02T09:42:20.229363+0000 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:20.243 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7fdfa7285114] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.244 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: clone() 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.245 INFO:tasks.ceph.mds.c.smithi050.stderr: 0> 2022-05-02T09:42:20.231+0000 7fdf979ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:20.250 INFO:tasks.ceph.mds.c.smithi050.stderr: in thread 7fdf979ed700 thread_name:mds_rank_progr 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdfa5a12ce0] 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: abort() 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7fdfa7285172] 2022-05-02T09:42:20.251 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.252 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.252 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.252 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.252 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 16: clone() 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:20.253 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.254 INFO:tasks.ceph.mds.c.smithi050.stderr: -1> 2022-05-02T09:42:20.229+0000 7fdf979ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fdf979ed700 time 2022-05-02T09:42:20.229363+0000 2022-05-02T09:42:20.254 INFO:tasks.ceph.mds.c.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:20.254 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.254 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.254 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7fdfa7285114] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.255 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: clone() 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 0> 2022-05-02T09:42:20.231+0000 7fdf979ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: in thread 7fdf979ed700 thread_name:mds_rank_progr 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdfa5a12ce0] 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 3: abort() 2022-05-02T09:42:20.256 INFO:tasks.ceph.mds.c.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7fdfa7285172] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7fdfa7285335] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55c6f7c3a5ed] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55c6f7ade799] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55c6f7ae012e] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55c6f7b232d6] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55c6f7b23618] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55c6f7b92e07] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55c6f7cfbc13] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55c6f79da764] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55c6f79dae95] 2022-05-02T09:42:20.257 INFO:tasks.ceph.mds.c.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fdfa5a081cf] 2022-05-02T09:42:20.258 INFO:tasks.ceph.mds.c.smithi050.stderr: 16: clone() 2022-05-02T09:42:20.258 INFO:tasks.ceph.mds.c.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:20.258 INFO:tasks.ceph.mds.c.smithi050.stderr: 2022-05-02T09:42:20.394 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.391+0000 7fa6ce7ff700 1 Processor -- start 2022-05-02T09:42:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.391+0000 7fa6ce7ff700 1 -- start start 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ce7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 0x7fa6c81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ce7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 0x7fa6c80a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ce7ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80a3740 con 0x7fa6c80a0ea0 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ce7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8141290 con 0x7fa6c80a3370 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ce7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81410d0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6c77fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 0x7fa6c80a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 0x7fa6c81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ccd9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6c80a0ea0 0x7fa6c80a1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52434/0 (socket says 172.21.15.50:52434) 2022-05-02T09:42:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.392+0000 7fa6ccd9c700 1 -- 172.21.15.50:0/583481932 learned_addr learned my addr 172.21.15.50:0/583481932 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c77fe700 1 -- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 msgr2=0x7fa6c81416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c77fe700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 0x7fa6c81416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c77fe700 1 -- 172.21.15.50:0/583481932 >> v1:172.21.15.50:6789/0 conn(0x7fa6c80a0ea0 legacy=0x7fa6c80a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c77fe700 1 -- 172.21.15.50:0/583481932 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80a1640 con 0x7fa6c8141bf0 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c7fff700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 0x7fa6c81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c77fe700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 0x7fa6c80a1a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009790 tx=0x7fa6bc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560801bf7736deb3 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c6ffd700 1 -- 172.21.15.50:0/583481932 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc011630 con 0x7fa6c8141bf0 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.393+0000 7fa6c6ffd700 1 -- 172.21.15.50:0/583481932 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc011790 con 0x7fa6c8141bf0 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6c6ffd700 1 -- 172.21.15.50:0/583481932 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc011b30 con 0x7fa6c8141bf0 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 msgr2=0x7fa6c80a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 0x7fa6c80a1a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009790 tx=0x7fa6bc009060 comp rx=0 tx=0).stop 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/583481932 shutdown_connections 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a3370 0x7fa6c81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/583481932 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c8141bf0 0x7fa6c80a1a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/583481932 >> 172.21.15.50:0/583481932 conn(0x7fa6c80b4090 msgr2=0x7fa6c80b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/583481932 shutdown_connections 2022-05-02T09:42:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.394+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/583481932 wait complete. 2022-05-02T09:42:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.396+0000 7fa6ce7ff700 1 Processor -- start 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.396+0000 7fa6ce7ff700 1 -- start start 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 0x7fa6c813cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 0x7fa6c81512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c813b740 con 0x7fa6c8141bf0 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8150df0 con 0x7fa6c80a0ea0 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ce7ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c813e550 con 0x7fa6c80a3370 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 0x7fa6c813cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6c77fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6ccd9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 0x7fa6c81512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6c77fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50082/0 (socket says 172.21.15.50:50082) 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 0x7fa6c813cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50750/0 (socket says 172.21.15.50:50750) 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.397+0000 7fa6c77fe700 1 -- 172.21.15.50:0/3104861618 learned_addr learned my addr 172.21.15.50:0/3104861618 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 -- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 msgr2=0x7fa6c813d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 -- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 msgr2=0x7fa6c813cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 0x7fa6c813cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 -- 172.21.15.50:0/3104861618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80092a0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6c77fe700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ccd9c700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 0x7fa6c81512a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005ad0 tx=0x7fa6c0001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00070d0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0007230 con 0x7fa6c8141bf0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00075b0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.398+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc0092a0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.399+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c8150fe0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.400+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c813eb10 con 0x7fa6c8141bf0 2022-05-02T09:42:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.400+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fa6c0019030 con 0x7fa6c8141bf0 2022-05-02T09:42:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.401+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa6c0058cf0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.404+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fa6c0037ae0 con 0x7fa6c8141bf0 2022-05-02T09:42:20.445 INFO:tasks.ceph.mds.c.smithi050.stderr:daemon-helper: command crashed with signal 6 2022-05-02T09:42:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:20.564+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fa6c804bfb0 con 0x7fa6c8141bf0 2022-05-02T09:42:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.224+0000 7fa6affff700 1 -- 172.21.15.50:0/3104861618 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa6c003b2d0 con 0x7fa6c8141bf0 2022-05-02T09:42:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.228+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 >> v1:172.21.15.50:6800/36423 conn(0x7fa6a8044b40 legacy=0x7fa6a8046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.228+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 msgr2=0x7fa6c81512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.228+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 0x7fa6c81512a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005ad0 tx=0x7fa6c0001490 comp rx=0 tx=0).stop 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 shutdown_connections 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c8141bf0 0x7fa6c81512a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa6c80a0ea0 0x7fa6c813cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 --2- 172.21.15.50:0/3104861618 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa6c80a3370 0x7fa6c813d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 >> 172.21.15.50:0/3104861618 conn(0x7fa6c80b4090 msgr2=0x7fa6c80a45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 shutdown_connections 2022-05-02T09:42:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.229+0000 7fa6ce7ff700 1 -- 172.21.15.50:0/3104861618 wait complete. 2022-05-02T09:42:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 2 pg_autoscale_mode to off 2022-05-02T09:42:21.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.392+0000 7f03d659d700 1 Processor -- start 2022-05-02T09:42:21.395 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.392+0000 7f03d659d700 1 -- start start 2022-05-02T09:42:21.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d659d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d013df90 0x7f03d00a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:21.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d659d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03d00a59e0 0x7f03d01482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:21.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d659d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00a8f70 con 0x7f03d00a9770 2022-05-02T09:42:21.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d659d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d013e570 con 0x7f03d00a59e0 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d659d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00a8390 con 0x7f03d013df90 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d559b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03d00a9770 0x7f03d00a7ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52436/0 (socket says 172.21.15.50:52436) 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d559b700 1 -- 172.21.15.50:0/3850981428 learned_addr learned my addr 172.21.15.50:0/3850981428 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d5d9c700 1 --2- 172.21.15.50:0/3850981428 >> v2:172.21.15.50:3300/0 conn(0x7f03d00a59e0 0x7f03d01482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.393+0000 7f03d4d9a700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d013df90 0x7f03d00a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03d5d9c700 1 -- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d013df90 msgr2=0x7f03d00a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03d5d9c700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d013df90 0x7f03d00a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03d5d9c700 1 -- 172.21.15.50:0/3850981428 >> v1:172.21.15.50:6789/0 conn(0x7f03d00a9770 legacy=0x7f03d00a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03d5d9c700 1 -- 172.21.15.50:0/3850981428 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00a8650 con 0x7f03d00a59e0 2022-05-02T09:42:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03bffff700 1 -- 172.21.15.50:0/3850981428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103984826 0 0) 0x7f03d00a8f70 con 0x7f03d00a9770 2022-05-02T09:42:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03d5d9c700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a59e0 0x7f03d01482c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009e60 tx=0x7f03c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4794858031406705 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03bffff700 1 -- 172.21.15.50:0/3850981428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800e070 con 0x7f03d00a59e0 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03bffff700 1 -- 172.21.15.50:0/3850981428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800bb60 con 0x7f03d00a59e0 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.394+0000 7f03bffff700 1 -- 172.21.15.50:0/3850981428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8012430 con 0x7f03d00a59e0 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 -- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a59e0 msgr2=0x7f03d01482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a59e0 0x7f03d01482c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009e60 tx=0x7f03c8009780 comp rx=0 tx=0).stop 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 -- 172.21.15.50:0/3850981428 shutdown_connections 2022-05-02T09:42:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a59e0 0x7f03d01482c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 --2- 172.21.15.50:0/3850981428 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d013df90 0x7f03d00a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 -- 172.21.15.50:0/3850981428 >> 172.21.15.50:0/3850981428 conn(0x7f03d0062fe0 msgr2=0x7f03d00633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 -- 172.21.15.50:0/3850981428 shutdown_connections 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.395+0000 7f03d659d700 1 -- 172.21.15.50:0/3850981428 wait complete. 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.397+0000 7f03d659d700 1 Processor -- start 2022-05-02T09:42:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.397+0000 7f03d659d700 1 -- start start 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.397+0000 7f03d659d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.397+0000 7f03d659d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 0x7f03d00ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d659d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f03d013df90 0x7f03d00aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d659d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00af2a0 con 0x7f03d00a9770 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d659d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00aced0 con 0x7f03d00a59e0 2022-05-02T09:42:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d659d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00ad190 con 0x7f03d013df90 2022-05-02T09:42:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d4d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 0x7f03d00ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50754/0 (socket says 172.21.15.50:50754) 2022-05-02T09:42:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 -- 172.21.15.50:0/343207632 learned_addr learned my addr 172.21.15.50:0/343207632 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d5d9c700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f03d013df90 0x7f03d00aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 -- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f03d013df90 msgr2=0x7f03d00aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f03d013df90 0x7f03d00aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 -- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 msgr2=0x7f03d00ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 0x7f03d00ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d559b700 1 -- 172.21.15.50:0/343207632 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009a20 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.398+0000 7f03d4d9a700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 0x7f03d00ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03d559b700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0011e0 tx=0x7f03cc007c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00ce10 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc007360 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0046b0 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d00acb90 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.399+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00ab700 con 0x7f03d00a59e0 2022-05-02T09:42:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.400+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d005ee50 con 0x7f03d00a59e0 2022-05-02T09:42:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.401+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f03cc010030 con 0x7f03d00a59e0 2022-05-02T09:42:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.401+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f03cc0591b0 con 0x7f03d00a59e0 2022-05-02T09:42:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.405+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f03cc038080 con 0x7f03d00a59e0 2022-05-02T09:42:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:21.565+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f03d01407d0 con 0x7f03d00a59e0 2022-05-02T09:42:22.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.234+0000 7f03bd7fa700 1 -- 172.21.15.50:0/343207632 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v39) v1 ==== 164+0+0 (secure 0 0 0) 0x7f03cc03b870 con 0x7f03d00a59e0 2022-05-02T09:42:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 >> v1:172.21.15.50:6800/36423 conn(0x7f03b0044b40 legacy=0x7f03b0046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 msgr2=0x7f03d00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0011e0 tx=0x7f03cc007c40 comp rx=0 tx=0).stop 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 shutdown_connections 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f03d013df90 0x7f03d00aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f03d00a59e0 0x7f03d00ad9b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 --2- 172.21.15.50:0/343207632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03d00a9770 0x7f03d00ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 >> 172.21.15.50:0/343207632 conn(0x7f03d0062fe0 msgr2=0x7f03d00a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 shutdown_connections 2022-05-02T09:42:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.237+0000 7f03d659d700 1 -- 172.21.15.50:0/343207632 wait complete. 2022-05-02T09:42:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 3 pg_autoscale_mode to off 2022-05-02T09:42:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.399+0000 7f11351ff700 1 Processor -- start 2022-05-02T09:42:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.399+0000 7f11351ff700 1 -- start start 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f11301416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130141290 con 0x7f1130141bf0 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301410d0 con 0x7f11300a3370 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.400+0000 7f11351ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11300a2a90 con 0x7f11300a0ea0 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112ed9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f11301416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50086/0 (socket says 172.21.15.50:50086) 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36210/0 (socket says 172.21.15.50:36210) 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 -- 172.21.15.50:0/3451677901 learned_addr learned my addr 172.21.15.50:0/3451677901 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112ed9d700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f11301416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50758/0 (socket says 172.21.15.50:50758) 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 -- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 msgr2=0x7f11301416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f11301416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 -- 172.21.15.50:0/3451677901 >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 msgr2=0x7f11300a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 --2- 172.21.15.50:0/3451677901 >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112f59e700 1 -- 172.21.15.50:0/3451677901 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300a3740 con 0x7f11300a0ea0 2022-05-02T09:42:22.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.401+0000 7f112e59c700 1 --2- 172.21.15.50:0/3451677901 >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:22.406 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.402+0000 7f112f59e700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1128009f20 tx=0x7f1128009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7275dd09667a61 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.402+0000 7f112dd9b700 1 -- 172.21.15.50:0/3451677901 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800e070 con 0x7f11300a0ea0 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.402+0000 7f112dd9b700 1 -- 172.21.15.50:0/3451677901 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800b970 con 0x7f11300a0ea0 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.402+0000 7f112dd9b700 1 -- 172.21.15.50:0/3451677901 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280092e0 con 0x7f11300a0ea0 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 -- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 msgr2=0x7f11300a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1128009f20 tx=0x7f1128009840 comp rx=0 tx=0).stop 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 -- 172.21.15.50:0/3451677901 shutdown_connections 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f11300a1fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 --2- 172.21.15.50:0/3451677901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f11301416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 --2- 172.21.15.50:0/3451677901 >> v2:172.21.15.50:3300/0 conn(0x7f1130141bf0 0x7f11300a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 -- 172.21.15.50:0/3451677901 >> 172.21.15.50:0/3451677901 conn(0x7f11300b4090 msgr2=0x7f11300b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 -- 172.21.15.50:0/3451677901 shutdown_connections 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.403+0000 7f11351ff700 1 -- 172.21.15.50:0/3451677901 wait complete. 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.404+0000 7f11351ff700 1 Processor -- start 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 -- start start 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1130141bf0 0x7f11300969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113009a420 con 0x7f1130141bf0 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300984e0 con 0x7f11300a3370 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.405+0000 7f11351ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113009a650 con 0x7f11300a0ea0 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50760/0 (socket says 172.21.15.50:50760) 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112ed9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50088/0 (socket says 172.21.15.50:50088) 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 -- 172.21.15.50:0/4123397306 learned_addr learned my addr 172.21.15.50:0/4123397306 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112f59e700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1130141bf0 0x7f11300969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 -- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 msgr2=0x7f113013d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 -- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1130141bf0 msgr2=0x7f11300969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1130141bf0 0x7f11300969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112e59c700 1 -- 172.21.15.50:0/4123397306 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240092a0 con 0x7f11300a3370 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.406+0000 7f112ed9d700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f112e59c700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f112400e900 tx=0x7f1124009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11240094e0 con 0x7f11300a3370 2022-05-02T09:42:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124013680 con 0x7f11300a3370 2022-05-02T09:42:22.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1128009ae0 con 0x7f11300a3370 2022-05-02T09:42:22.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124013a40 con 0x7f11300a3370 2022-05-02T09:42:22.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.407+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130098d50 con 0x7f11300a3370 2022-05-02T09:42:22.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.408+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113004bfb0 con 0x7f11300a3370 2022-05-02T09:42:22.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.409+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f1124019030 con 0x7f11300a3370 2022-05-02T09:42:22.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.409+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f1124059690 con 0x7f11300a3370 2022-05-02T09:42:22.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.413+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f11240384e0 con 0x7f11300a3370 2022-05-02T09:42:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:22.572+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f113004b770 con 0x7f11300a3370 2022-05-02T09:42:23.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.234+0000 7f1116ffd700 1 -- 172.21.15.50:0/4123397306 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7f112403bcd0 con 0x7f11300a3370 2022-05-02T09:42:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.238+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 >> v1:172.21.15.50:6800/36423 conn(0x7f1110044b40 legacy=0x7f1110046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.238+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 msgr2=0x7f1130099180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.238+0000 7f11351ff700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f112400e900 tx=0x7f1124009060 comp rx=0 tx=0).stop 2022-05-02T09:42:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 shutdown_connections 2022-05-02T09:42:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f11300a0ea0 0x7f113013d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1130141bf0 0x7f11300969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 --2- 172.21.15.50:0/4123397306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11300a3370 0x7f1130099180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 >> 172.21.15.50:0/4123397306 conn(0x7f11300b4090 msgr2=0x7f11300b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:23.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 shutdown_connections 2022-05-02T09:42:23.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.239+0000 7f11351ff700 1 -- 172.21.15.50:0/4123397306 wait complete. 2022-05-02T09:42:23.243 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 pg_autoscale_mode to off 2022-05-02T09:42:23.270 INFO:teuthology.run_tasks:Running task ceph.healthy... 2022-05-02T09:42:23.287 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-05-02T09:42:23.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-05-02T09:42:23.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-05-02T09:42:23.512 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.510+0000 7fe7c7fff700 1 Processor -- start 2022-05-02T09:42:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.510+0000 7fe7c7fff700 1 -- start start 2022-05-02T09:42:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c81410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 0x7fe7c813b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c8063a90 con 0x7fe7c80a9bc0 2022-05-02T09:42:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80a8eb0 con 0x7fe7c80636c0 2022-05-02T09:42:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8141a70 con 0x7fe7c81415e0 2022-05-02T09:42:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.511+0000 7fe7c77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 0x7fe7c813b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c81410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50092/0 (socket says 172.21.15.50:50092) 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c67fc700 1 -- 172.21.15.50:0/2208069103 learned_addr learned my addr 172.21.15.50:0/2208069103 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 0x7fe7c813b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36216/0 (socket says 172.21.15.50:36216) 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 msgr2=0x7fe7c813ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/2208069103 >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 msgr2=0x7fe7c813b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/2208069103 >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 0x7fe7c813b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/2208069103 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8141d30 con 0x7fe7c80636c0 2022-05-02T09:42:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c67fc700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.512+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c81410a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8006fd0 tx=0x7fe7b8006f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa690b218312182c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c5ffb700 1 -- 172.21.15.50:0/2208069103 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8004030 con 0x7fe7c80636c0 2022-05-02T09:42:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c5ffb700 1 -- 172.21.15.50:0/2208069103 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8004190 con 0x7fe7c80636c0 2022-05-02T09:42:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c5ffb700 1 -- 172.21.15.50:0/2208069103 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8005a90 con 0x7fe7c80636c0 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 -- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 msgr2=0x7fe7c81410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c81410a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8006fd0 tx=0x7fe7b8006f40 comp rx=0 tx=0).stop 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 -- 172.21.15.50:0/2208069103 shutdown_connections 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/2208069103 >> v2:172.21.15.50:3300/0 conn(0x7fe7c80a9bc0 0x7fe7c813b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c81410a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/2208069103 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c81415e0 0x7fe7c813ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.513+0000 7fe7c7fff700 1 -- 172.21.15.50:0/2208069103 >> 172.21.15.50:0/2208069103 conn(0x7fe7c8069370 msgr2=0x7fe7c8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.514+0000 7fe7c7fff700 1 -- 172.21.15.50:0/2208069103 shutdown_connections 2022-05-02T09:42:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.514+0000 7fe7c7fff700 1 -- 172.21.15.50:0/2208069103 wait complete. 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.515+0000 7fe7c7fff700 1 Processor -- start 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 -- start start 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c80a9bc0 0x7fe7c814dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7c81415e0 0x7fe7c8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8150b40 con 0x7fe7c81415e0 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80abfb0 con 0x7fe7c80636c0 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.516+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80b4590 con 0x7fe7c80a9bc0 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7c81415e0 0x7fe7c8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c67fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c80a9bc0 0x7fe7c814dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50766/0 (socket says 172.21.15.50:50766) 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/1577105642 learned_addr learned my addr 172.21.15.50:0/1577105642 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c80a9bc0 msgr2=0x7fe7c814dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c80a9bc0 0x7fe7c814dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7c81415e0 msgr2=0x7fe7c8150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7c81415e0 0x7fe7c8150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.517+0000 7fe7c6ffd700 1 -- 172.21.15.50:0/1577105642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc009370 con 0x7fe7c80636c0 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7c6ffd700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80a8ff0 tx=0x7fe7b8015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8004030 con 0x7fe7c80636c0 2022-05-02T09:42:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b80067a0 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b8009250 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80036f0 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.518+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c814e420 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.519+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c80a6ca0 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.519+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fe7b8024020 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.520+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe7b805add0 con 0x7fe7c80636c0 2022-05-02T09:42:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.524+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fe7b8028a60 con 0x7fe7c80636c0 2022-05-02T09:42:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.713+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe7c806f690 con 0x7fe7c80636c0 2022-05-02T09:42:23.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.715+0000 7fe7aeffd700 1 -- 172.21.15.50:0/1577105642 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+103811 (secure 0 0 0) 0x7fe7b8017030 con 0x7fe7c80636c0 2022-05-02T09:42:23.719 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.717+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 >> v1:172.21.15.50:6800/36423 conn(0x7fe7a8044b40 legacy=0x7fe7a8046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.717+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 msgr2=0x7fe7c80aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.717+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80a8ff0 tx=0x7fe7b8015000 comp rx=0 tx=0).stop 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 shutdown_connections 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7c81415e0 0x7fe7c8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7c80636c0 0x7fe7c80aba70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 --2- 172.21.15.50:0/1577105642 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fe7c80a9bc0 0x7fe7c814dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 >> 172.21.15.50:0/1577105642 conn(0x7fe7c8069370 msgr2=0x7fe7c813b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:23.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 shutdown_connections 2022-05-02T09:42:23.722 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.718+0000 7fe7c7fff700 1 -- 172.21.15.50:0/1577105642 wait complete. 2022-05-02T09:42:23.745 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"active_gid":14098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6800","nonce":36423}]},"active_addr":"172.21.15.50:6800/36423","active_change":"2022-05-02T09:41:50.599821+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14115,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":21,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1767466811}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":641395050}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1184292988}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":348996454}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3031448067}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":759996247}]}]}} 2022-05-02T09:42:23.760 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-05-02T09:42:23.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-05-02T09:42:23.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.980+0000 7f53a97ff700 1 Processor -- start 2022-05-02T09:42:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.980+0000 7f53a97ff700 1 -- start start 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a97ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a97ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 0x7f53a4148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a97ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40a9970 con 0x7f53a40b4c80 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a97ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40a9b20 con 0x7f53a40636c0 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a97ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4063a90 con 0x7f53a413b1f0 2022-05-02T09:42:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.981+0000 7f53a2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a37fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 0x7f53a4148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50768/0 (socket says 172.21.15.50:50768) 2022-05-02T09:42:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 -- 172.21.15.50:0/4090794685 learned_addr learned my addr 172.21.15.50:0/4090794685 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a27fc700 1 --1- 172.21.15.50:0/4090794685 >> v1:172.21.15.50:6789/0 conn(0x7f53a40b4c80 0x7f53a413aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52438/0 (socket says 172.21.15.50:52438) 2022-05-02T09:42:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 -- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 msgr2=0x7f53a4148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 0x7f53a4148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 -- 172.21.15.50:0/4090794685 >> v1:172.21.15.50:6789/0 conn(0x7f53a40b4c80 legacy=0x7f53a413aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 -- 172.21.15.50:0/4090794685 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40a9470 con 0x7f53a40636c0 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a1ffb700 1 -- 172.21.15.50:0/4090794685 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922907342 0 0) 0x7f53a40a9970 con 0x7f53a40b4c80 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a37fe700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 0x7f53a4148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.982+0000 7f53a2ffd700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5394009830 tx=0x7f53940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560cdf19f5e42a61 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a1ffb700 1 -- 172.21.15.50:0/4090794685 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394004030 con 0x7f53a40636c0 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a1ffb700 1 -- 172.21.15.50:0/4090794685 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394004190 con 0x7f53a40636c0 2022-05-02T09:42:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a1ffb700 1 -- 172.21.15.50:0/4090794685 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011630 con 0x7f53a40636c0 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 -- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 msgr2=0x7f53a40a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5394009830 tx=0x7f53940090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 -- 172.21.15.50:0/4090794685 shutdown_connections 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a413b1f0 0x7f53a4148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4090794685 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40a7ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.983+0000 7f53a97ff700 1 -- 172.21.15.50:0/4090794685 >> 172.21.15.50:0/4090794685 conn(0x7f53a4069590 msgr2=0x7f53a4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.984+0000 7f53a97ff700 1 -- 172.21.15.50:0/4090794685 shutdown_connections 2022-05-02T09:42:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.984+0000 7f53a97ff700 1 -- 172.21.15.50:0/4090794685 wait complete. 2022-05-02T09:42:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.986+0000 7f53a97ff700 1 Processor -- start 2022-05-02T09:42:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.986+0000 7f53a97ff700 1 -- start start 2022-05-02T09:42:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 0x7f53a40b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a413b1f0 0x7f53a40acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40b0020 con 0x7f53a413b1f0 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a414dd90 con 0x7f53a40636c0 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a97ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53a414e050 con 0x7f53a40b4c80 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a27fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 0x7f53a40b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.987+0000 7f53a2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50770/0 (socket says 172.21.15.50:50770) 2022-05-02T09:42:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a2ffd700 1 -- 172.21.15.50:0/4232117259 learned_addr learned my addr 172.21.15.50:0/4232117259 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a37fe700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a413b1f0 0x7f53a40acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 -- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 msgr2=0x7f53a40af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 -- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a413b1f0 msgr2=0x7f53a40acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a413b1f0 0x7f53a40acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 -- 172.21.15.50:0/4232117259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009a20 con 0x7f53a40b4c80 2022-05-02T09:42:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a2ffd700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.988+0000 7f53a27fc700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 0x7f53a40b0800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398007ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.989+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800ce00 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.989+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980072e0 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.989+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394009370 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.989+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398005670 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.989+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a414e790 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.990+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4063180 con 0x7f53a40b4c80 2022-05-02T09:42:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.991+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f5398019030 con 0x7f53a40b4c80 2022-05-02T09:42:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.992+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5398058870 con 0x7f53a40b4c80 2022-05-02T09:42:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:23.997+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f5398037690 con 0x7f53a40b4c80 2022-05-02T09:42:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.156+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53a404bfb0 con 0x7f53a40b4c80 2022-05-02T09:42:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.157+0000 7f538affd700 1 -- 172.21.15.50:0/4232117259 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11633 (secure 0 0 0) 0x7f5398017020 con 0x7f53a40b4c80 2022-05-02T09:42:24.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:24.160 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:23.229204+0000","last_up_change":"2022-05-02T09:42:10.107171+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":38604}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":38604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":38604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":38604}]},"public_addr":"172.21.15.50:6805/38604","cluster_addr":"172.21.15.50:6806/38604","heartbeat_back_addr":"172.21.15.50:6808/38604","heartbeat_front_addr":"172.21.15.50:6807/38604","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":38708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":38708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":38708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":38708}]},"public_addr":"172.21.15.50:6809/38708","cluster_addr":"172.21.15.50:6810/38708","heartbeat_back_addr":"172.21.15.50:6812/38708","heartbeat_front_addr":"172.21.15.50:6811/38708","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":31,"up_thru":31,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":38853}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":38853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":38853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":38853}]},"public_addr":"172.21.15.50:6813/38853","cluster_addr":"172.21.15.50:6814/38853","heartbeat_back_addr":"172.21.15.50:6816/38853","heartbeat_front_addr":"172.21.15.50:6815/38853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6819/3706979787":"2022-05-03T09:42:17.093955+0000","172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 >> v1:172.21.15.50:6800/36423 conn(0x7f5384044b40 legacy=0x7f5384046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 msgr2=0x7f53a40b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 0x7f53a40b0800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398007ae0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 shutdown_connections 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a413b1f0 0x7f53a40acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a40636c0 0x7f53a40af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 --2- 172.21.15.50:0/4232117259 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f53a40b4c80 0x7f53a40b0800 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 >> 172.21.15.50:0/4232117259 conn(0x7f53a4069590 msgr2=0x7f53a413a090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 shutdown_connections 2022-05-02T09:42:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.159+0000 7f53a97ff700 1 -- 172.21.15.50:0/4232117259 wait complete. 2022-05-02T09:42:24.187 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-05-02T09:42:24.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.408+0000 7f0961b9d700 1 Processor -- start 2022-05-02T09:42:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.408+0000 7f0961b9d700 1 -- start start 2022-05-02T09:42:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0961b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0961b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 0x7f095c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0961b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095c0a2200 con 0x7f095c0a1e30 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0961b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c06f210 con 0x7f095c0a7db0 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0961b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c06f4f0 con 0x7f095c06e860 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f095bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f095bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36222/0 (socket says 172.21.15.50:36222) 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f096139c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 0x7f095c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f095bfff700 1 -- 172.21.15.50:0/1631640768 learned_addr learned my addr 172.21.15.50:0/1631640768 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.409+0000 7f0960b9b700 1 --1- 172.21.15.50:0/1631640768 >> v1:172.21.15.50:6789/0 conn(0x7f095c0a1e30 0x7f095c13dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52440/0 (socket says 172.21.15.50:52440) 2022-05-02T09:42:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f096139c700 1 -- 172.21.15.50:0/1631640768 >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 msgr2=0x7f095c06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f096139c700 1 --2- 172.21.15.50:0/1631640768 >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f096139c700 1 -- 172.21.15.50:0/1631640768 >> v1:172.21.15.50:6789/0 conn(0x7f095c0a1e30 legacy=0x7f095c13dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f096139c700 1 -- 172.21.15.50:0/1631640768 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c06def0 con 0x7f095c06e860 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f095bfff700 1 --2- 172.21.15.50:0/1631640768 >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f096139c700 1 --2- 172.21.15.50:0/1631640768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 0x7f095c147fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0954009e60 tx=0x7f0954009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ebe20262d8fd72 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f095b7fe700 1 -- 172.21.15.50:0/1631640768 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095400e070 con 0x7f095c06e860 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f095b7fe700 1 -- 172.21.15.50:0/1631640768 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095400bb60 con 0x7f095c06e860 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.410+0000 7f095b7fe700 1 -- 172.21.15.50:0/1631640768 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954012430 con 0x7f095c06e860 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 -- 172.21.15.50:0/1631640768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 msgr2=0x7f095c147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 --2- 172.21.15.50:0/1631640768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 0x7f095c147fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0954009e60 tx=0x7f0954009780 comp rx=0 tx=0).stop 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 -- 172.21.15.50:0/1631640768 shutdown_connections 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 --2- 172.21.15.50:0/1631640768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c06e860 0x7f095c147fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 --2- 172.21.15.50:0/1631640768 >> v2:172.21.15.50:3300/0 conn(0x7f095c0a7db0 0x7f095c06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 -- 172.21.15.50:0/1631640768 >> 172.21.15.50:0/1631640768 conn(0x7f095c062df0 msgr2=0x7f095c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 -- 172.21.15.50:0/1631640768 shutdown_connections 2022-05-02T09:42:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.411+0000 7f0961b9d700 1 -- 172.21.15.50:0/1631640768 wait complete. 2022-05-02T09:42:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.413+0000 7f0961b9d700 1 Processor -- start 2022-05-02T09:42:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.413+0000 7f0961b9d700 1 -- start start 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 0x7f095c0ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 0x7f095c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c0aadd0 con 0x7f095c06e860 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c0ac790 con 0x7f095c0a7db0 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0961b9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f095c0aca70 con 0x7f095c0a1e30 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0960b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f095bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 0x7f095c0ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0960b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36224/0 (socket says 172.21.15.50:36224) 2022-05-02T09:42:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f0960b9b700 1 -- 172.21.15.50:0/3602531659 learned_addr learned my addr 172.21.15.50:0/3602531659 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.414+0000 7f096139c700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 0x7f095c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 -- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 msgr2=0x7f095c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 0x7f095c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 -- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 msgr2=0x7f095c0abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 -- 172.21.15.50:0/3602531659 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948009370 con 0x7f095c0a1e30 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f0960b9b700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f096139c700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 0x7f095c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f095bfff700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 0x7f095c0ab260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f094800e970 tx=0x7f09480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.415+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948013680 con 0x7f095c0a1e30 2022-05-02T09:42:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.416+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480137e0 con 0x7f095c0a1e30 2022-05-02T09:42:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.416+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948013b80 con 0x7f095c0a1e30 2022-05-02T09:42:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.416+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954009a20 con 0x7f095c0a1e30 2022-05-02T09:42:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.416+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c0a8660 con 0x7f095c0a1e30 2022-05-02T09:42:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.417+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095c0ab0b0 con 0x7f095c0a1e30 2022-05-02T09:42:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.417+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f0948019030 con 0x7f095c0a1e30 2022-05-02T09:42:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.418+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0948059810 con 0x7f095c0a1e30 2022-05-02T09:42:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.422+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f09480387d0 con 0x7f095c0a1e30 2022-05-02T09:42:24.583 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.581+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f095c04bfb0 con 0x7f095c0a1e30 2022-05-02T09:42:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.582+0000 7f0958ff9700 1 -- 172.21.15.50:0/3602531659 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11633 (secure 0 0 0) 0x7f0948021030 con 0x7f095c0a1e30 2022-05-02T09:42:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:24.585 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:23.229204+0000","last_up_change":"2022-05-02T09:42:10.107171+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":38604}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":38604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":38604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":38604}]},"public_addr":"172.21.15.50:6805/38604","cluster_addr":"172.21.15.50:6806/38604","heartbeat_back_addr":"172.21.15.50:6808/38604","heartbeat_front_addr":"172.21.15.50:6807/38604","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":38708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":38708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":38708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":38708}]},"public_addr":"172.21.15.50:6809/38708","cluster_addr":"172.21.15.50:6810/38708","heartbeat_back_addr":"172.21.15.50:6812/38708","heartbeat_front_addr":"172.21.15.50:6811/38708","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":31,"up_thru":31,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":38853}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":38853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":38853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":38853}]},"public_addr":"172.21.15.50:6813/38853","cluster_addr":"172.21.15.50:6814/38853","heartbeat_back_addr":"172.21.15.50:6816/38853","heartbeat_front_addr":"172.21.15.50:6815/38853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6819/3706979787":"2022-05-03T09:42:17.093955+0000","172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 >> v1:172.21.15.50:6800/36423 conn(0x7f0944044b70 legacy=0x7f0944047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 msgr2=0x7f095c0ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 0x7f095c0ab260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f094800e970 tx=0x7f09480090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 shutdown_connections 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f095c0a7db0 0x7f095c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f095c06e860 0x7f095c0abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 --2- 172.21.15.50:0/3602531659 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f095c0a1e30 0x7f095c0ab260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 >> 172.21.15.50:0/3602531659 conn(0x7f095c062df0 msgr2=0x7f095c0631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 shutdown_connections 2022-05-02T09:42:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.584+0000 7f0961b9d700 1 -- 172.21.15.50:0/3602531659 wait complete. 2022-05-02T09:42:24.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-05-02T09:42:24.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-05-02T09:42:24.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-05-02T09:42:24.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-05-02T09:42:24.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.864+0000 7fab9d39d700 1 Processor -- start 2022-05-02T09:42:24.867 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.864+0000 7fab9d39d700 1 -- start start 2022-05-02T09:42:24.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.865+0000 7f68c5dff700 1 Processor -- start 2022-05-02T09:42:24.868 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.865+0000 7f68c5dff700 1 -- start start 2022-05-02T09:42:24.869 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.865+0000 7fab9d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab980a35d0 0x7fab980aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab9d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab9d39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980a3e50 con 0x7fab98141940 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab9d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980a39a0 con 0x7fab980a35d0 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab9d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab980af400 con 0x7fab9806d520 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab977fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab977fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50102/0 (socket says 172.21.15.50:50102) 2022-05-02T09:42:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab977fe700 1 -- 172.21.15.50:0/2918801444 learned_addr learned my addr 172.21.15.50:0/2918801444 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.866+0000 7fab9cb9c700 1 --1- 172.21.15.50:0/2918801444 >> v1:172.21.15.50:6789/0 conn(0x7fab98141940 0x7fab9806e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52442/0 (socket says 172.21.15.50:52442) 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab96ffd700 1 -- 172.21.15.50:0/2918801444 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169752768 0 0) 0x7fab980a3e50 con 0x7fab98141940 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab96ffd700 1 -- 172.21.15.50:0/2918801444 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab840033f0 con 0x7fab98141940 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab977fe700 1 -- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab980a35d0 msgr2=0x7fab980aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab977fe700 1 --2- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab980a35d0 0x7fab980aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab977fe700 1 -- 172.21.15.50:0/2918801444 >> v1:172.21.15.50:6789/0 conn(0x7fab98141940 legacy=0x7fab9806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7fab977fe700 1 -- 172.21.15.50:0/2918801444 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab98069d90 con 0x7fab9806d520 2022-05-02T09:42:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7f68c5dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7f68c5dff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68c013e270 0x7f68c013e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7f68c5dff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00a0780 con 0x7f68c006d0c0 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7f68c5dff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c013dcd0 con 0x7f68c013e270 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.867+0000 7f68c5dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00a1a40 con 0x7f68c00a03b0 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7f68bffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68c006d0c0 0x7f68c006d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52444/0 (socket says 172.21.15.50:52444) 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7f68bffff700 1 -- 172.21.15.50:0/1874228140 learned_addr learned my addr 172.21.15.50:0/1874228140 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7fab977fe700 1 --2- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009860 tx=0x7fab8c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e3eeda451f9d4c server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7fab96ffd700 1 -- 172.21.15.50:0/2918801444 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c004030 con 0x7fab9806d520 2022-05-02T09:42:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7fab96ffd700 1 -- 172.21.15.50:0/2918801444 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c004190 con 0x7fab9806d520 2022-05-02T09:42:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.868+0000 7fab96ffd700 1 -- 172.21.15.50:0/2918801444 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c011630 con 0x7fab9806d520 2022-05-02T09:42:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68beffd700 1 --2- 172.21.15.50:0/1874228140 >> v2:172.21.15.50:3300/0 conn(0x7f68c013e270 0x7f68c013e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68bf7fe700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68be7fc700 1 -- 172.21.15.50:0/1874228140 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246049596 0 0) 0x7f68c00a0780 con 0x7f68c006d0c0 2022-05-02T09:42:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68be7fc700 1 -- 172.21.15.50:0/1874228140 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ac0033f0 con 0x7f68c006d0c0 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68beffd700 1 -- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 msgr2=0x7f68c006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68beffd700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68beffd700 1 -- 172.21.15.50:0/1874228140 >> v1:172.21.15.50:6789/0 conn(0x7f68c006d0c0 legacy=0x7f68c006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7f68beffd700 1 -- 172.21.15.50:0/1874228140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c006cab0 con 0x7f68c013e270 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7fab9d39d700 1 -- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 msgr2=0x7fab98141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.869+0000 7fab9d39d700 1 --2- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009860 tx=0x7fab8c0090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7f68beffd700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c013e270 0x7f68c013e660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009760 tx=0x7f68b4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e374860ee04be723 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 -- 172.21.15.50:0/2918801444 shutdown_connections 2022-05-02T09:42:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 --2- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab980a35d0 0x7fab980aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 --2- 172.21.15.50:0/2918801444 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab9806d520 0x7fab98141400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 -- 172.21.15.50:0/2918801444 >> 172.21.15.50:0/2918801444 conn(0x7fab98062df0 msgr2=0x7fab980631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 -- 172.21.15.50:0/2918801444 shutdown_connections 2022-05-02T09:42:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7fab9d39d700 1 -- 172.21.15.50:0/2918801444 wait complete. 2022-05-02T09:42:24.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7f68be7fc700 1 -- 172.21.15.50:0/1874228140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40105b0 con 0x7f68c013e270 2022-05-02T09:42:24.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7f68be7fc700 1 -- 172.21.15.50:0/1874228140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4010710 con 0x7f68c013e270 2022-05-02T09:42:24.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.870+0000 7f68be7fc700 1 -- 172.21.15.50:0/1874228140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4010ab0 con 0x7f68c013e270 2022-05-02T09:42:24.879 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7fab9d39d700 1 Processor -- start 2022-05-02T09:42:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7fab9d39d700 1 -- start start 2022-05-02T09:42:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f7a52d9d700 1 Processor -- start 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 -- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c013e270 msgr2=0x7f68c013e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c013e270 0x7f68c013e660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009760 tx=0x7f68b4009060 comp rx=0 tx=0).stop 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 -- 172.21.15.50:0/1874228140 shutdown_connections 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 --2- 172.21.15.50:0/1874228140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c013e270 0x7f68c013e660 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f68c5dff700 1 -- 172.21.15.50:0/1874228140 >> 172.21.15.50:0/1874228140 conn(0x7f68c0062df0 msgr2=0x7f68c00631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.872+0000 7f7a52d9d700 1 -- start start 2022-05-02T09:42:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7f68c5dff700 1 -- 172.21.15.50:0/1874228140 shutdown_connections 2022-05-02T09:42:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7f68c5dff700 1 -- 172.21.15.50:0/1874228140 wait complete. 2022-05-02T09:42:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab9806d520 0x7fab980999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab980a35d0 0x7fab98097740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab98141940 0x7fab98150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98098de0 con 0x7fab9806d520 2022-05-02T09:42:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab98096ac0 con 0x7fab98141940 2022-05-02T09:42:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.873+0000 7fab9d39d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab98098aa0 con 0x7fab980a35d0 2022-05-02T09:42:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7fab977fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab980a35d0 0x7fab98097740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7fab977fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab980a35d0 0x7fab98097740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50104/0 (socket says 172.21.15.50:50104) 2022-05-02T09:42:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7fab977fe700 1 -- 172.21.15.50:0/392706913 learned_addr learned my addr 172.21.15.50:0/392706913 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7fab97fff700 1 --2- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab9806d520 0x7fab980999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a4c0636c0 0x7f7a4c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c140ff0 con 0x7f7a4c0636c0 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c063a90 con 0x7f7a4c0a9bf0 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.874+0000 7f7a52d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0a9200 con 0x7f7a4c1419c0 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a4c0636c0 0x7f7a4c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 -- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab980a35d0 msgr2=0x7fab98097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 --2- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fab980a35d0 0x7fab98097740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 -- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab98141940 msgr2=0x7fab98150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 --2- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab98141940 0x7fab98150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 -- 172.21.15.50:0/392706913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c009370 con 0x7fab9806d520 2022-05-02T09:42:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a4c0636c0 0x7f7a4c141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36232/0 (socket says 172.21.15.50:36232) 2022-05-02T09:42:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7f7a51d9b700 1 -- 172.21.15.50:0/2310087764 learned_addr learned my addr 172.21.15.50:0/2310087764 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7f7a5159a700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7fab97fff700 1 --2- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab9806d520 0x7fab980999f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab8800b4e0 tx=0x7fab88009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.875+0000 7f68c5dff700 1 Processor -- start 2022-05-02T09:42:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f68c5dff700 1 -- start start 2022-05-02T09:42:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 -- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 msgr2=0x7f7a4c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 -- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 msgr2=0x7f7a4c13e540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:42:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 -- 172.21.15.50:0/2310087764 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c141e50 con 0x7f7a4c0636c0 2022-05-02T09:42:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88011630 con 0x7fab9806d520 2022-05-02T09:42:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88011790 con 0x7fab9806d520 2022-05-02T09:42:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88011b10 con 0x7fab9806d520 2022-05-02T09:42:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab980ac940 con 0x7fab9806d520 2022-05-02T09:42:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c141480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a48006fd0 tx=0x7f7a480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e7399a0753d001 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.876+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980ae610 con 0x7fab9806d520 2022-05-02T09:42:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f7a50d99700 1 -- 172.21.15.50:0/2310087764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004030 con 0x7f7a4c0636c0 2022-05-02T09:42:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f7a50d99700 1 -- 172.21.15.50:0/2310087764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480041d0 con 0x7f7a4c0636c0 2022-05-02T09:42:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f7a50d99700 1 -- 172.21.15.50:0/2310087764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011630 con 0x7f7a4c0636c0 2022-05-02T09:42:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c006d0c0 0x7f68c0142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab980973c0 con 0x7fab9806d520 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 0x7f68c0143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0151980 con 0x7f68c006d0c0 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00b01d0 con 0x7f68c00a03b0 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.877+0000 7f68c5dff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0142d30 con 0x7f68c013e270 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 0x7f68c0143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 0x7f68c0143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50108/0 (socket says 172.21.15.50:50108) 2022-05-02T09:42:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 -- 172.21.15.50:0/1801783733 learned_addr learned my addr 172.21.15.50:0/1801783733 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bf7fe700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c006d0c0 0x7f68c0142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68beffd700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f7a52d9d700 1 -- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 msgr2=0x7f7a4c141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f7a52d9d700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c141480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a48006fd0 tx=0x7f7a480090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 -- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 msgr2=0x7f68c0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68c00a03b0 0x7f68c0141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 -- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c006d0c0 msgr2=0x7f68c0142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c006d0c0 0x7f68c0142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.878+0000 7f68bffff700 1 -- 172.21.15.50:0/1801783733 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40092a0 con 0x7f68c013e270 2022-05-02T09:42:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fab88021070 con 0x7fab9806d520 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 -- 172.21.15.50:0/2310087764 shutdown_connections 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c141480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 --2- 172.21.15.50:0/2310087764 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 -- 172.21.15.50:0/2310087764 >> 172.21.15.50:0/2310087764 conn(0x7f7a4c069370 msgr2=0x7f7a4c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.901 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f68bffff700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 0x7f68c0143230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68b800c7c0 tx=0x7f68b8007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 -- 172.21.15.50:0/2310087764 shutdown_connections 2022-05-02T09:42:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8005d30 con 0x7f68c013e270 2022-05-02T09:42:24.903 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.879+0000 7f7a52d9d700 1 -- 172.21.15.50:0/2310087764 wait complete. 2022-05-02T09:42:24.903 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b8005e90 con 0x7f68c013e270 2022-05-02T09:42:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c00aff90 con 0x7f68c013e270 2022-05-02T09:42:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b80072e0 con 0x7f68c013e270 2022-05-02T09:42:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0151b70 con 0x7f68c013e270 2022-05-02T09:42:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fab88059540 con 0x7fab9806d520 2022-05-02T09:42:24.904 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.881+0000 7f386579d700 1 Processor -- start 2022-05-02T09:42:24.905 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 --> v1:172.21.15.50:6809/38708 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab78051640 con 0x7fab7804da20 2022-05-02T09:42:24.905 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.880+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab8805b9c0 con 0x7fab9806d520 2022-05-02T09:42:24.905 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.881+0000 7f386579d700 1 -- start start 2022-05-02T09:42:24.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.881+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68c00a21a0 con 0x7f68c013e270 2022-05-02T09:42:24.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f7a52d9d700 1 Processor -- start 2022-05-02T09:42:24.906 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f7a52d9d700 1 -- start start 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f386006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 0x7f386013ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386013b670 con 0x7f386013bf70 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386013b860 con 0x7f38600a5a60 2022-05-02T09:42:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.882+0000 7f386579d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f386013bb20 con 0x7f386006ed30 2022-05-02T09:42:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f385ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f68b8019030 con 0x7f68c013e270 2022-05-02T09:42:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f3864f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 0x7f386013ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f385ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50110/0 (socket says 172.21.15.50:50110) 2022-05-02T09:42:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f385ffff700 1 -- 172.21.15.50:0/2456902854 learned_addr learned my addr 172.21.15.50:0/2456902854 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f385f7fe700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f386006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c12a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c12db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c12af00 con 0x7f7a4c0636c0 2022-05-02T09:42:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0b3c60 con 0x7f7a4c0a9bf0 2022-05-02T09:42:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a52d9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0b3f00 con 0x7f7a4c1419c0 2022-05-02T09:42:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.883+0000 7f7a5159a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f7a5159a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50788/0 (socket says 172.21.15.50:50788) 2022-05-02T09:42:24.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f7a5159a700 1 -- 172.21.15.50:0/319459710 learned_addr learned my addr 172.21.15.50:0/319459710 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f68b80595c0 con 0x7f68c013e270 2022-05-02T09:42:24.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 --> v1:172.21.15.50:6805/38604 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a0051570 con 0x7f68a004d950 2022-05-02T09:42:24.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68b80598f0 con 0x7f68c013e270 2022-05-02T09:42:24.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== osd.2 v1:172.21.15.50:6809/38708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (unknown 0 0 729909304) 0x7fab78051640 con 0x7fab7804da20 2022-05-02T09:42:24.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f385ffff700 1 -- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 msgr2=0x7f386006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.913 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f385ffff700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f386006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f385ffff700 1 -- 172.21.15.50:0/2456902854 >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 msgr2=0x7f386013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f385ffff700 1 --2- 172.21.15.50:0/2456902854 >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 0x7f386013ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f385ffff700 1 -- 172.21.15.50:0/2456902854 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386006c4f0 con 0x7f386006ed30 2022-05-02T09:42:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f3864f9c700 1 --2- 172.21.15.50:0/2456902854 >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 0x7f386013ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:24.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.884+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c12a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f385ffff700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3854006fd0 tx=0x7f38540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9bd7bfa073a8629 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f7a51d9b700 1 -- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 msgr2=0x7f7a4c12db30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-05-02T09:42:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f7a4c1419c0 0x7f7a4c12db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f7a51d9b700 1 -- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 msgr2=0x7f7a4c13c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a4c0a9bf0 0x7f7a4c13c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f385effd700 1 -- 172.21.15.50:0/2456902854 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854004030 con 0x7f386006ed30 2022-05-02T09:42:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f7a51d9b700 1 -- 172.21.15.50:0/319459710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48009370 con 0x7f7a4c0636c0 2022-05-02T09:42:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f385effd700 1 -- 172.21.15.50:0/2456902854 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854004190 con 0x7f386006ed30 2022-05-02T09:42:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.885+0000 7f385effd700 1 -- 172.21.15.50:0/2456902854 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011630 con 0x7f386006ed30 2022-05-02T09:42:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a51d9b700 1 --2- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c12a9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a48015000 tx=0x7f7a48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480036f0 con 0x7f7a4c0636c0 2022-05-02T09:42:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48003870 con 0x7f7a4c0636c0 2022-05-02T09:42:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003c30 con 0x7f7a4c0636c0 2022-05-02T09:42:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c13cb60 con 0x7f7a4c0636c0 2022-05-02T09:42:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f386579d700 1 -- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 msgr2=0x7f386006b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f386579d700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3854006fd0 tx=0x7f38540090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.919 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.886+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c0b2070 con 0x7f7a4c0636c0 2022-05-02T09:42:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.887+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== osd.1 v1:172.21.15.50:6805/38604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (unknown 0 0 729909304) 0x7f68a0051570 con 0x7f68a004d950 2022-05-02T09:42:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.887+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a4c0a6ca0 con 0x7f7a4c0636c0 2022-05-02T09:42:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 -- 172.21.15.50:0/2456902854 shutdown_connections 2022-05-02T09:42:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 --2- 172.21.15.50:0/2456902854 >> v2:172.21.15.50:3300/0 conn(0x7f386013bf70 0x7f386013ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f386006b180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 --2- 172.21.15.50:0/2456902854 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f386006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 -- 172.21.15.50:0/2456902854 >> 172.21.15.50:0/2456902854 conn(0x7f3860062df0 msgr2=0x7f38600631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 -- 172.21.15.50:0/2456902854 shutdown_connections 2022-05-02T09:42:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f386579d700 1 -- 172.21.15.50:0/2456902854 wait complete. 2022-05-02T09:42:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.888+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f7a48017020 con 0x7f7a4c0636c0 2022-05-02T09:42:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.889+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f7a4805ab50 con 0x7f7a4c0636c0 2022-05-02T09:42:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.889+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 --> v1:172.21.15.50:6813/38853 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a2c0514f0 con 0x7f7a2c04d8d0 2022-05-02T09:42:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.889+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a4805f220 con 0x7f7a4c0636c0 2022-05-02T09:42:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.890+0000 7f386579d700 1 Processor -- start 2022-05-02T09:42:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.890+0000 7f386579d700 1 -- start start 2022-05-02T09:42:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.891+0000 7f386579d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f38601497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.891+0000 7f386579d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f38600a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.891+0000 7f386579d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 0x7f38600a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:24.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f386579d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600a7900 con 0x7f386013bf70 2022-05-02T09:42:24.928 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f386579d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600a9630 con 0x7f38600a5a60 2022-05-02T09:42:24.929 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f386579d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38600b0590 con 0x7f386006ed30 2022-05-02T09:42:24.929 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== osd.3 v1:172.21.15.50:6813/38853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (unknown 0 0 729909304) 0x7f7a2c0514f0 con 0x7f7a2c04d8d0 2022-05-02T09:42:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f3864f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 0x7f38600a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f385ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f38601497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f3864f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 0x7f38600a7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36240/0 (socket says 172.21.15.50:36240) 2022-05-02T09:42:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.892+0000 7f3864f9c700 1 -- 172.21.15.50:0/3288447768 learned_addr learned my addr 172.21.15.50:0/3288447768 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 -- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 msgr2=0x7f38600a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 --2- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38600a5a60 0x7f38600a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 -- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 msgr2=0x7f38600a7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 --2- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 0x7f38600a7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 -- 172.21.15.50:0/3288447768 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385000d740 con 0x7f386006ed30 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f3864f9c700 1 --2- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f386013bf70 0x7f38600a7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f385ffff700 1 --2- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f38601497f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38600a2950 tx=0x7f3854016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.893+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540036f0 con 0x7f386006ed30 2022-05-02T09:42:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.894+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854003890 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.894+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3854009370 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.894+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854003c50 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.894+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600a6be0 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.895+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3860067630 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.896+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f385402b020 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.896+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f385405b8a0 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.897+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 --> v1:172.21.15.50:6801/38513 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38400514f0 con 0x7f384004d8d0 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.897+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3854060220 con 0x7f386006ed30 2022-05-02T09:42:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.898+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== osd.0 v1:172.21.15.50:6801/38513 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (unknown 0 0 729909304) 0x7f38400514f0 con 0x7f384004d8d0 2022-05-02T09:42:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.907+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 --> v1:172.21.15.50:6805/38604 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68c0136620 con 0x7f68a004d950 2022-05-02T09:42:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68a77fe700 1 -- 172.21.15.50:0/1801783733 <== osd.1 v1:172.21.15.50:6805/38604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 469651936) 0x7f68c0136620 con 0x7f68a004d950 2022-05-02T09:42:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 >> v1:172.21.15.50:6805/38604 conn(0x7f68a004d950 legacy=0x7f68a004fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 >> v1:172.21.15.50:6800/36423 conn(0x7f68a0044bc0 legacy=0x7f68a0047070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 msgr2=0x7f68c0143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68c5dff700 1 --2- 172.21.15.50:0/1801783733 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f68c013e270 0x7f68c0143230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68b800c7c0 tx=0x7f68b8007f70 comp rx=0 tx=0).stop 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.908+0000 7f68bffff700 1 -- 172.21.15.50:0/1801783733 reap_dead start 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.909+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 shutdown_connections 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.909+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 >> 172.21.15.50:0/1801783733 conn(0x7f68c0062df0 msgr2=0x7f68c0137c80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.909+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 shutdown_connections 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.909+0000 7f68c5dff700 1 -- 172.21.15.50:0/1801783733 wait complete. 2022-05-02T09:42:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.911+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 --> v1:172.21.15.50:6813/38853 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a4c0aa0f0 con 0x7f7a2c04d8d0 2022-05-02T09:42:24.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.911+0000 7f7a39ffb700 1 -- 172.21.15.50:0/319459710 <== osd.3 v1:172.21.15.50:6813/38853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 469651936) 0x7f7a4c0aa0f0 con 0x7f7a2c04d8d0 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 >> v1:172.21.15.50:6813/38853 conn(0x7f7a2c04d8d0 legacy=0x7f7a2c04fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 >> v1:172.21.15.50:6800/36423 conn(0x7f7a2c044b40 legacy=0x7f7a2c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 msgr2=0x7f7a4c12a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 --2- 172.21.15.50:0/319459710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a4c0636c0 0x7f7a4c12a9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a48015000 tx=0x7f7a48016000 comp rx=0 tx=0).stop 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a5259c700 1 -- 172.21.15.50:0/319459710 reap_dead start 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 shutdown_connections 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 >> 172.21.15.50:0/319459710 conn(0x7f7a4c069370 msgr2=0x7f7a4c147790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 shutdown_connections 2022-05-02T09:42:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.912+0000 7f7a52d9d700 1 -- 172.21.15.50:0/319459710 wait complete. 2022-05-02T09:42:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.913+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 --> v1:172.21.15.50:6809/38708 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab9804bfb0 con 0x7fab7804da20 2022-05-02T09:42:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.914+0000 7fab7ffff700 1 -- 172.21.15.50:0/392706913 <== osd.2 v1:172.21.15.50:6809/38708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 469651936) 0x7fab9804bfb0 con 0x7fab7804da20 2022-05-02T09:42:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 >> v1:172.21.15.50:6809/38708 conn(0x7fab7804da20 legacy=0x7fab7804fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 >> v1:172.21.15.50:6800/36423 conn(0x7fab78044c90 legacy=0x7fab78047140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab9806d520 msgr2=0x7fab980999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 --2- 172.21.15.50:0/392706913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab9806d520 0x7fab980999f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab8800b4e0 tx=0x7fab88009060 comp rx=0 tx=0).stop 2022-05-02T09:42:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9cb9c700 1 -- 172.21.15.50:0/392706913 reap_dead start 2022-05-02T09:42:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 shutdown_connections 2022-05-02T09:42:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 >> 172.21.15.50:0/392706913 conn(0x7fab98062df0 msgr2=0x7fab980b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 shutdown_connections 2022-05-02T09:42:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.915+0000 7fab9d39d700 1 -- 172.21.15.50:0/392706913 wait complete. 2022-05-02T09:42:24.943 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.925+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 --> v1:172.21.15.50:6801/38513 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f386006bf10 con 0x7f384004d8d0 2022-05-02T09:42:24.943 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.925+0000 7f3847fff700 1 -- 172.21.15.50:0/3288447768 <== osd.0 v1:172.21.15.50:6801/38513 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3806383025) 0x7f386006bf10 con 0x7f384004d8d0 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.926+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 >> v1:172.21.15.50:6801/38513 conn(0x7f384004d8d0 legacy=0x7f384004fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.926+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 >> v1:172.21.15.50:6800/36423 conn(0x7f3840044b40 legacy=0x7f3840046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.926+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 msgr2=0x7f38601497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.926+0000 7f386579d700 1 --2- 172.21.15.50:0/3288447768 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f386006ed30 0x7f38601497f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38600a2950 tx=0x7f3854016000 comp rx=0 tx=0).stop 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.927+0000 7f3864f9c700 1 -- 172.21.15.50:0/3288447768 reap_dead start 2022-05-02T09:42:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.927+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 shutdown_connections 2022-05-02T09:42:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.927+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 >> 172.21.15.50:0/3288447768 conn(0x7f3860062df0 msgr2=0x7f38601379e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.927+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 shutdown_connections 2022-05-02T09:42:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:24.927+0000 7f386579d700 1 -- 172.21.15.50:0/3288447768 wait complete. 2022-05-02T09:42:24.947 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:24.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:42:24.948 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:24.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:42:24.949 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:24.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:42:24.958 INFO:teuthology.orchestra.run.smithi050.stdout:124554051589 2022-05-02T09:42:24.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:42:25.200 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.198+0000 7fa04bfff700 1 Processor -- start 2022-05-02T09:42:25.201 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.198+0000 7fa04bfff700 1 -- start start 2022-05-02T09:42:25.201 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 0x7fa04c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.201 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c1419c0 0x7fa04c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.202 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.202 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c140ff0 con 0x7fa04c0636c0 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c063a90 con 0x7fa04c1419c0 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.199+0000 7fa04bfff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0a9200 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.200+0000 7fa04b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.200+0000 7fa04affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 0x7fa04c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.200+0000 7fa04b7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50114/0 (socket says 172.21.15.50:50114) 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.200+0000 7fa04b7fe700 1 -- 172.21.15.50:0/4139069912 learned_addr learned my addr 172.21.15.50:0/4139069912 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.203 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.200+0000 7fa04a7fc700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c1419c0 0x7fa04c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 -- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c1419c0 msgr2=0x7fa04c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c1419c0 0x7fa04c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 -- 172.21.15.50:0/4139069912 >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 msgr2=0x7fa04c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 --2- 172.21.15.50:0/4139069912 >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 0x7fa04c141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.204 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 -- 172.21.15.50:0/4139069912 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c141e50 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04affd700 1 --2- 172.21.15.50:0/4139069912 >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 0x7fa04c141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:25.205 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.201+0000 7fa04b7fe700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa044009f50 tx=0x7fa044009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3fa8c4bdc70a5b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.203+0000 7fa049ffb700 1 -- 172.21.15.50:0/4139069912 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400e070 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.203+0000 7fa049ffb700 1 -- 172.21.15.50:0/4139069912 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400ba50 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.206 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.203+0000 7fa049ffb700 1 -- 172.21.15.50:0/4139069912 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440092e0 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 -- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 msgr2=0x7fa04c13e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa044009f50 tx=0x7fa044009840 comp rx=0 tx=0).stop 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 -- 172.21.15.50:0/4139069912 shutdown_connections 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c13e540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 --2- 172.21.15.50:0/4139069912 >> v2:172.21.15.50:3300/0 conn(0x7fa04c0636c0 0x7fa04c141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.207 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 --2- 172.21.15.50:0/4139069912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c1419c0 0x7fa04c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.204+0000 7fa04bfff700 1 -- 172.21.15.50:0/4139069912 >> 172.21.15.50:0/4139069912 conn(0x7fa04c069370 msgr2=0x7fa04c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.206+0000 7fa04bfff700 1 -- 172.21.15.50:0/4139069912 shutdown_connections 2022-05-02T09:42:25.208 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.206+0000 7fa04bfff700 1 -- 172.21.15.50:0/4139069912 wait complete. 2022-05-02T09:42:25.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.206+0000 7fdb8119d700 1 Processor -- start 2022-05-02T09:42:25.209 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.206+0000 7fdb8119d700 1 -- start start 2022-05-02T09:42:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.207+0000 7fa04bfff700 1 Processor -- start 2022-05-02T09:42:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fa04bfff700 1 -- start start 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb8119d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb7c0636c0 0x7fdb7c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb8119d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c0a9bf0 0x7fdb7c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb8119d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c140ff0 con 0x7fdb7c1419c0 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb8119d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c063a90 con 0x7fdb7c0636c0 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb8119d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0a9200 con 0x7fdb7c0a9bf0 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb7bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb7c0636c0 0x7fdb7c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb7bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb7c0636c0 0x7fdb7c141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36244/0 (socket says 172.21.15.50:36244) 2022-05-02T09:42:25.212 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb7bfff700 1 -- 172.21.15.50:0/3689700251 learned_addr learned my addr 172.21.15.50:0/3689700251 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.212 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.208+0000 7fdb7b7fe700 1 --1- 172.21.15.50:0/3689700251 >> v1:172.21.15.50:6789/0 conn(0x7fdb7c1419c0 0x7fdb7c13e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52446/0 (socket says 172.21.15.50:52446) 2022-05-02T09:42:25.212 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fdb8099c700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c0a9bf0 0x7fdb7c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.212 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 0x7fa04c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 0x7fa04c139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0adf50 con 0x7fa04c1419c0 2022-05-02T09:42:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ad7e0 con 0x7fa04c0636c0 2022-05-02T09:42:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fa04bfff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ac450 con 0x7fa04c0a9bf0 2022-05-02T09:42:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fdb7bfff700 1 -- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c0a9bf0 msgr2=0x7fdb7c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fdb7bfff700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c0a9bf0 0x7fdb7c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fdb7bfff700 1 -- 172.21.15.50:0/3689700251 >> v1:172.21.15.50:6789/0 conn(0x7fdb7c1419c0 legacy=0x7fdb7c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.209+0000 7fdb7bfff700 1 -- 172.21.15.50:0/3689700251 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c141e50 con 0x7fdb7c0636c0 2022-05-02T09:42:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fa04a7fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fa04b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 0x7fa04c139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fa04affd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 0x7fa04c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fa04a7fc700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c139980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50116/0 (socket says 172.21.15.50:50116) 2022-05-02T09:42:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fa04a7fc700 1 -- 172.21.15.50:0/381633326 learned_addr learned my addr 172.21.15.50:0/381633326 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.210+0000 7fdb7bfff700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c141480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c006fd0 tx=0x7fdb6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880ed0eee9350931 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fa04affd700 1 -- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 msgr2=0x7fa04c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fa04affd700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fa04affd700 1 -- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 msgr2=0x7fa04c139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fa04affd700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 0x7fa04c139ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fa04affd700 1 -- 172.21.15.50:0/381633326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0092a0 con 0x7fa04c0636c0 2022-05-02T09:42:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fdb7affd700 1 -- 172.21.15.50:0/3689700251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c004030 con 0x7fdb7c0636c0 2022-05-02T09:42:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fdb7affd700 1 -- 172.21.15.50:0/3689700251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0041d0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fdb7affd700 1 -- 172.21.15.50:0/3689700251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c011630 con 0x7fdb7c0636c0 2022-05-02T09:42:25.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fdb8119d700 1 -- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 msgr2=0x7fdb7c141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.211+0000 7fdb8119d700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c141480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c006fd0 tx=0x7fdb6c0090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fa04b7fe700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 0x7fa04c139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-02T09:42:25.219 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fa04affd700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 0x7fa04c0ace70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00e980 tx=0x7fa03c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 -- 172.21.15.50:0/3689700251 shutdown_connections 2022-05-02T09:42:25.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c0a9bf0 0x7fdb7c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 --2- 172.21.15.50:0/3689700251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c141480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 -- 172.21.15.50:0/3689700251 >> 172.21.15.50:0/3689700251 conn(0x7fdb7c069370 msgr2=0x7fdb7c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.220 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 -- 172.21.15.50:0/3689700251 shutdown_connections 2022-05-02T09:42:25.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fdb8119d700 1 -- 172.21.15.50:0/3689700251 wait complete. 2022-05-02T09:42:25.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00ee70 con 0x7fa04c0636c0 2022-05-02T09:42:25.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00c7f0 con 0x7fa04c0636c0 2022-05-02T09:42:25.221 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.212+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00cbb0 con 0x7fa04c0636c0 2022-05-02T09:42:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.214+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa044009ae0 con 0x7fa04c0636c0 2022-05-02T09:42:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.214+0000 7fdb8119d700 1 Processor -- start 2022-05-02T09:42:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.214+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0b4ca0 con 0x7fa04c0636c0 2022-05-02T09:42:25.223 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.214+0000 7fdb8119d700 1 -- start start 2022-05-02T09:42:25.223 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdb7c0a9bf0 0x7fdb7c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c1419c0 0x7fdb7c0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0af820 con 0x7fdb7c0636c0 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0b1260 con 0x7fdb7c1419c0 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fdb8119d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0afa20 con 0x7fdb7c0a9bf0 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.215+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c13d2a0 con 0x7fa04c0636c0 2022-05-02T09:42:25.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fa03c019030 con 0x7fa04c0636c0 2022-05-02T09:42:25.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36248/0 (socket says 172.21.15.50:36248) 2022-05-02T09:42:25.225 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 -- 172.21.15.50:0/1488493946 learned_addr learned my addr 172.21.15.50:0/1488493946 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 -- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdb7c0a9bf0 msgr2=0x7fdb7c0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdb7c0a9bf0 0x7fdb7c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 -- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c1419c0 msgr2=0x7fdb7c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c1419c0 0x7fdb7c0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.216+0000 7fdb7bfff700 1 -- 172.21.15.50:0/1488493946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c009370 con 0x7fdb7c0636c0 2022-05-02T09:42:25.226 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.217+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa03c0594d0 con 0x7fa04c0636c0 2022-05-02T09:42:25.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.217+0000 7fdb7bfff700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c004000 tx=0x7fdb6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.227 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.219+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c003770 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.219+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0038f0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.219+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c003cb0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.220+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c0afcc0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.220+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0ad100 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.221+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb58005120 con 0x7fdb7c0636c0 2022-05-02T09:42:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7f18319ff700 1 Processor -- start 2022-05-02T09:42:25.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7f90a33ff700 1 Processor -- start 2022-05-02T09:42:25.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7f18319ff700 1 -- start start 2022-05-02T09:42:25.229 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fa03c038320 con 0x7fa04c0636c0 2022-05-02T09:42:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fdb6c017020 con 0x7fdb7c0636c0 2022-05-02T09:42:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.222+0000 7f90a33ff700 1 -- start start 2022-05-02T09:42:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.223+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fdb6c05b1e0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.223+0000 7f18319ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f182c0a9830 0x7f182c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.223+0000 7f18319ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c13e790 0x7f182c140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f18319ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0a9310 con 0x7f182c13dfe0 2022-05-02T09:42:25.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f18319ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c0a90a0 con 0x7f182c0a9830 2022-05-02T09:42:25.231 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f18319ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0a7fe0 con 0x7f182c13e790 2022-05-02T09:42:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f182affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f182c0a9830 0x7f182c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a33ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f909c06dd10 0x7f909c0a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a33ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 0x7f909c13dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a33ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c06d2f0 con 0x7f909c0a0eb0 2022-05-02T09:42:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a33ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c06e0e0 con 0x7f909c06dd10 2022-05-02T09:42:25.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a33ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0a1340 con 0x7f909c0a01f0 2022-05-02T09:42:25.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f182affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f182c0a9830 0x7f182c0a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36250/0 (socket says 172.21.15.50:36250) 2022-05-02T09:42:25.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f182affd700 1 -- 172.21.15.50:0/1503973249 learned_addr learned my addr 172.21.15.50:0/1503973249 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.224+0000 7f90a119b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f909c06dd10 0x7f909c0a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.234 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f90a119b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f909c06dd10 0x7f909c0a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36252/0 (socket says 172.21.15.50:36252) 2022-05-02T09:42:25.234 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f90a119b700 1 -- 172.21.15.50:0/1202431049 learned_addr learned my addr 172.21.15.50:0/1202431049 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.234 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f182affd700 1 -- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c13e790 msgr2=0x7f182c140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f182affd700 1 --2- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c13e790 0x7f182c140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f182affd700 1 -- 172.21.15.50:0/1503973249 >> v1:172.21.15.50:6789/0 conn(0x7f182c13dfe0 legacy=0x7f182c141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.225+0000 7f182affd700 1 -- 172.21.15.50:0/1503973249 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0a8280 con 0x7f182c0a9830 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a199c700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 0x7f909c13dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a119b700 1 -- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 msgr2=0x7f909c13dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a119b700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 0x7f909c13dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a119b700 1 -- 172.21.15.50:0/1202431049 >> v1:172.21.15.50:6789/0 conn(0x7f909c0a0eb0 legacy=0x7f909c13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a119b700 1 -- 172.21.15.50:0/1202431049 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0a15e0 con 0x7f909c06dd10 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a199c700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 0x7f909c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:42:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f182affd700 1 --2- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c0a9830 0x7f182c0a5800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1824009f20 tx=0x7f1824009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d272c68c90cab278 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.226+0000 7f90a119b700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c06dd10 0x7f909c0a0970 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f908c006fd0 tx=0x7f908c008190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654f0c44bc224976 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.237 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f1829ffb700 1 -- 172.21.15.50:0/1503973249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400e070 con 0x7f182c0a9830 2022-05-02T09:42:25.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f908bfff700 1 -- 172.21.15.50:0/1202431049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c010070 con 0x7f909c06dd10 2022-05-02T09:42:25.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f908bfff700 1 -- 172.21.15.50:0/1202431049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c004030 con 0x7f909c06dd10 2022-05-02T09:42:25.238 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f908bfff700 1 -- 172.21.15.50:0/1202431049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0043d0 con 0x7f909c06dd10 2022-05-02T09:42:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f1829ffb700 1 -- 172.21.15.50:0/1503973249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400ba40 con 0x7f182c0a9830 2022-05-02T09:42:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7f1829ffb700 1 -- 172.21.15.50:0/1503973249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240092e0 con 0x7f182c0a9830 2022-05-02T09:42:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.228+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fdb6c026c10 con 0x7fdb7c0636c0 2022-05-02T09:42:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 -- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c0a9830 msgr2=0x7f182c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 --2- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c0a9830 0x7f182c0a5800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1824009f20 tx=0x7f1824009840 comp rx=0 tx=0).stop 2022-05-02T09:42:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 -- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c06dd10 msgr2=0x7f909c0a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c06dd10 0x7f909c0a0970 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f908c006fd0 tx=0x7f908c008190 comp rx=0 tx=0).stop 2022-05-02T09:42:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 -- 172.21.15.50:0/1503973249 shutdown_connections 2022-05-02T09:42:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 --2- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c0a9830 0x7f182c0a5800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 --2- 172.21.15.50:0/1503973249 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c13e790 0x7f182c140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f18319ff700 1 -- 172.21.15.50:0/1503973249 >> 172.21.15.50:0/1503973249 conn(0x7f182c062df0 msgr2=0x7f182c0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 -- 172.21.15.50:0/1202431049 shutdown_connections 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a01f0 0x7f909c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1202431049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c06dd10 0x7f909c0a0970 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 -- 172.21.15.50:0/1202431049 >> 172.21.15.50:0/1202431049 conn(0x7f909c06a6a0 msgr2=0x7f909c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 -- 172.21.15.50:0/1202431049 shutdown_connections 2022-05-02T09:42:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.229+0000 7f90a33ff700 1 -- 172.21.15.50:0/1202431049 wait complete. 2022-05-02T09:42:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.230+0000 7f18319ff700 1 -- 172.21.15.50:0/1503973249 shutdown_connections 2022-05-02T09:42:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.231+0000 7f18319ff700 1 -- 172.21.15.50:0/1503973249 wait complete. 2022-05-02T09:42:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.231+0000 7f90a33ff700 1 Processor -- start 2022-05-02T09:42:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.231+0000 7f90a33ff700 1 -- start start 2022-05-02T09:42:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f909c06dd10 0x7f909c09e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 0x7f909c0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0a7720 con 0x7f909c0a01f0 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0a81a0 con 0x7f909c0a0eb0 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a33ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0a8ee0 con 0x7f909c06dd10 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.232+0000 7f90a199c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50806/0 (socket says 172.21.15.50:50806) 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 -- 172.21.15.50:0/1472628635 learned_addr learned my addr 172.21.15.50:0/1472628635 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.245 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a119b700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f909c06dd10 0x7f909c09e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.246 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f18319ff700 1 Processor -- start 2022-05-02T09:42:25.246 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f18319ff700 1 -- start start 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 -- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f909c06dd10 msgr2=0x7f909c09e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f909c06dd10 0x7f909c09e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 -- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 msgr2=0x7f909c0a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a099a700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 0x7f909c0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 0x7f909c0a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a199c700 1 -- 172.21.15.50:0/1472628635 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0083f0 con 0x7f909c0a0eb0 2022-05-02T09:42:25.248 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.233+0000 7f90a099a700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 0x7f909c0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:42:25.248 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f90a199c700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f909400a380 tx=0x7f9094007900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f182c13dfe0 0x7f182c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 0x7f182c1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1419f0 con 0x7f182c13e790 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0aece0 con 0x7f182c0a9830 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.234+0000 7f18319ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b1630 con 0x7f182c13dfe0 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50808/0 (socket says 172.21.15.50:50808) 2022-05-02T09:42:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 -- 172.21.15.50:0/1776619048 learned_addr learned my addr 172.21.15.50:0/1776619048 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182a7fc700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f182c13dfe0 0x7f182c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400ae10 con 0x7f909c0a0eb0 2022-05-02T09:42:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400d650 con 0x7f909c0a0eb0 2022-05-02T09:42:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400da10 con 0x7f909c0a0eb0 2022-05-02T09:42:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 -- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f182c13dfe0 msgr2=0x7f182c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182b7fe700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 0x7f182c1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f182c13dfe0 0x7f182c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 -- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 msgr2=0x7f182c1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 0x7f182c1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f182affd700 1 -- 172.21.15.50:0/1776619048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009ae0 con 0x7f182c0a9830 2022-05-02T09:42:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0a91a0 con 0x7f909c0a0eb0 2022-05-02T09:42:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.235+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c0a6a20 con 0x7f909c0a0eb0 2022-05-02T09:42:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.236+0000 7f182affd700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f182c0a94a0 tx=0x7f1824017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:25.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f182b7fe700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 0x7f182c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-02T09:42:25.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0a7870 con 0x7f909c0a0eb0 2022-05-02T09:42:25.253 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f909401c030 con 0x7f909c0a0eb0 2022-05-02T09:42:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824004030 con 0x7f182c0a9830 2022-05-02T09:42:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824004190 con 0x7f182c0a9830 2022-05-02T09:42:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824004530 con 0x7f182c0a9830 2022-05-02T09:42:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.237+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c0aea00 con 0x7f182c0a9830 2022-05-02T09:42:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.238+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0ab5f0 con 0x7f182c0a9830 2022-05-02T09:42:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.238+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f909405d350 con 0x7f909c0a0eb0 2022-05-02T09:42:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.239+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c04bfb0 con 0x7f182c0a9830 2022-05-02T09:42:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.242+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f909c0a7870 con 0x7f909c0a0eb0 2022-05-02T09:42:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.243+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f182402c070 con 0x7f182c0a9830 2022-05-02T09:42:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.244+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f182405af40 con 0x7f182c0a9830 2022-05-02T09:42:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.247+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f18240089c0 con 0x7f182c0a9830 2022-05-02T09:42:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.406+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f909c0a7870 con 0x7f909c0a0eb0 2022-05-02T09:42:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.407+0000 7f90897fa700 1 -- 172.21.15.50:0/1472628635 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f909c0a7870 con 0x7f909c0a0eb0 2022-05-02T09:42:25.410 INFO:teuthology.orchestra.run.smithi050.stdout:133143986180 2022-05-02T09:42:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 >> v1:172.21.15.50:6800/36423 conn(0x7f907c044c10 legacy=0x7f907c0470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 msgr2=0x7f909c13a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f909400a380 tx=0x7f9094007900 comp rx=0 tx=0).stop 2022-05-02T09:42:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 shutdown_connections 2022-05-02T09:42:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f909c06dd10 0x7f909c09e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f909c0a0eb0 0x7f909c13a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 --2- 172.21.15.50:0/1472628635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f909c0a01f0 0x7f909c0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.409+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 >> 172.21.15.50:0/1472628635 conn(0x7f909c06a6a0 msgr2=0x7f909c0a0690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.410+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 shutdown_connections 2022-05-02T09:42:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.410+0000 7f90a33ff700 1 -- 172.21.15.50:0/1472628635 wait complete. 2022-05-02T09:42:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.411+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f182c0a5d40 con 0x7f182c0a9830 2022-05-02T09:42:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.412+0000 7f1812ffd700 1 -- 172.21.15.50:0/1776619048 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1824034090 con 0x7f182c0a9830 2022-05-02T09:42:25.414 INFO:teuthology.orchestra.run.smithi050.stdout:133143986180 2022-05-02T09:42:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.414+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 >> v1:172.21.15.50:6800/36423 conn(0x7f180c044b40 legacy=0x7f180c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.414+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 msgr2=0x7f182c0ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.414+0000 7f18319ff700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f182c0a94a0 tx=0x7f1824017000 comp rx=0 tx=0).stop 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 shutdown_connections 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f182c13e790 0x7f182c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f182c0a9830 0x7f182c0ac7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 --2- 172.21.15.50:0/1776619048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f182c13dfe0 0x7f182c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 >> 172.21.15.50:0/1776619048 conn(0x7f182c062df0 msgr2=0x7f182c0b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 shutdown_connections 2022-05-02T09:42:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.415+0000 7f18319ff700 1 -- 172.21.15.50:0/1776619048 wait complete. 2022-05-02T09:42:25.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.430+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb580053d0 con 0x7fdb7c0636c0 2022-05-02T09:42:25.435 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.430+0000 7fdb63fff700 1 -- 172.21.15.50:0/1488493946 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb6c026c10 con 0x7fdb7c0636c0 2022-05-02T09:42:25.435 INFO:teuthology.orchestra.run.smithi050.stdout:124554051588 2022-05-02T09:42:25.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.432+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 >> v1:172.21.15.50:6800/36423 conn(0x7fdb5c044c40 legacy=0x7fdb5c0470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.432+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 msgr2=0x7fdb7c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.436 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.432+0000 7fdb8119d700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c004000 tx=0x7fdb6c016000 comp rx=0 tx=0).stop 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 shutdown_connections 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb7c1419c0 0x7fdb7c0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb7c0636c0 0x7fdb7c0adb60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 --2- 172.21.15.50:0/1488493946 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fdb7c0a9bf0 0x7fdb7c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 >> 172.21.15.50:0/1488493946 conn(0x7fdb7c069370 msgr2=0x7fdb7c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 shutdown_connections 2022-05-02T09:42:25.437 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.433+0000 7fdb8119d700 1 -- 172.21.15.50:0/1488493946 wait complete. 2022-05-02T09:42:25.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986180 for osd.3 2022-05-02T09:42:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.438+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa04c13a4c0 con 0x7fa04c0636c0 2022-05-02T09:42:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.438+0000 7fa032ffd700 1 -- 172.21.15.50:0/381633326 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa03c03bb10 con 0x7fa04c0636c0 2022-05-02T09:42:25.441 INFO:teuthology.orchestra.run.smithi050.stdout:133143986180 2022-05-02T09:42:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 >> v1:172.21.15.50:6800/36423 conn(0x7fa02c044b40 legacy=0x7fa02c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 msgr2=0x7fa04c0ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 0x7fa04c0ace70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00e980 tx=0x7fa03c009060 comp rx=0 tx=0).stop 2022-05-02T09:42:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 shutdown_connections 2022-05-02T09:42:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa04c1419c0 0x7fa04c139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa04c0636c0 0x7fa04c0ace70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 --2- 172.21.15.50:0/381633326 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fa04c0a9bf0 0x7fa04c139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 >> 172.21.15.50:0/381633326 conn(0x7fa04c069370 msgr2=0x7fa04c13ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 shutdown_connections 2022-05-02T09:42:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:25.441+0000 7fa04bfff700 1 -- 172.21.15.50:0/381633326 wait complete. 2022-05-02T09:42:25.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986180 for osd.2 2022-05-02T09:42:25.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051589 got 124554051588 for osd.0 2022-05-02T09:42:25.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986180 for osd.1 2022-05-02T09:42:26.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-05-02T09:42:26.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-05-02T09:42:26.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-05-02T09:42:26.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-05-02T09:42:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.701+0000 7eff14f9d700 1 Processor -- start 2022-05-02T09:42:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.701+0000 7eff14f9d700 1 -- start start 2022-05-02T09:42:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.702+0000 7eff14f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 0x7eff10141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.702+0000 7eff14f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 0x7eff1013e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.702+0000 7eff14f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10140ff0 con 0x7eff100a9bf0 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.702+0000 7eff14f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff10063a90 con 0x7eff100636c0 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.702+0000 7eff14f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100a9200 con 0x7eff101419c0 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.703+0000 7eff0ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7eff100a9bf0 0x7eff100a4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52452/0 (socket says 172.21.15.50:52452) 2022-05-02T09:42:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.703+0000 7eff0ffff700 1 -- 172.21.15.50:0/1990393181 learned_addr learned my addr 172.21.15.50:0/1990393181 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.703+0000 7eff0effd700 1 --2- 172.21.15.50:0/1990393181 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 0x7eff1013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.703+0000 7eff0f7fe700 1 --2- 172.21.15.50:0/1990393181 >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 0x7eff10141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.703+0000 7eff0e7fc700 1 -- 172.21.15.50:0/1990393181 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122669220 0 0) 0x7eff10140ff0 con 0x7eff100a9bf0 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0e7fc700 1 -- 172.21.15.50:0/1990393181 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efefc0033f0 con 0x7eff100a9bf0 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0effd700 1 -- 172.21.15.50:0/1990393181 >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 msgr2=0x7eff10141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0effd700 1 --2- 172.21.15.50:0/1990393181 >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 0x7eff10141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0effd700 1 -- 172.21.15.50:0/1990393181 >> v1:172.21.15.50:6789/0 conn(0x7eff100a9bf0 legacy=0x7eff100a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0effd700 1 -- 172.21.15.50:0/1990393181 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10141e50 con 0x7eff101419c0 2022-05-02T09:42:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0f7fe700 1 --2- 172.21.15.50:0/1990393181 >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 0x7eff10141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.704+0000 7eff0effd700 1 --2- 172.21.15.50:0/1990393181 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 0x7eff1013e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff04009760 tx=0x7eff04009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d9fba400c7ca140 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.705+0000 7eff0e7fc700 1 -- 172.21.15.50:0/1990393181 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011630 con 0x7eff101419c0 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.705+0000 7eff0e7fc700 1 -- 172.21.15.50:0/1990393181 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04011790 con 0x7eff101419c0 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.705+0000 7eff0e7fc700 1 -- 172.21.15.50:0/1990393181 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011b10 con 0x7eff101419c0 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 -- 172.21.15.50:0/1990393181 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 msgr2=0x7eff1013e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1990393181 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 0x7eff1013e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff04009760 tx=0x7eff04009060 comp rx=0 tx=0).stop 2022-05-02T09:42:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 -- 172.21.15.50:0/1990393181 shutdown_connections 2022-05-02T09:42:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1990393181 >> v2:172.21.15.50:3300/0 conn(0x7eff100636c0 0x7eff10141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1990393181 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff101419c0 0x7eff1013e000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 -- 172.21.15.50:0/1990393181 >> 172.21.15.50:0/1990393181 conn(0x7eff10069370 msgr2=0x7eff10062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 -- 172.21.15.50:0/1990393181 shutdown_connections 2022-05-02T09:42:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.706+0000 7eff14f9d700 1 -- 172.21.15.50:0/1990393181 wait complete. 2022-05-02T09:42:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.709+0000 7eff14f9d700 1 Processor -- start 2022-05-02T09:42:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.709+0000 7eff14f9d700 1 -- start start 2022-05-02T09:42:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff100a9bf0 0x7eff100ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 0x7eff10150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1014e0b0 con 0x7eff100636c0 2022-05-02T09:42:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff10096f50 con 0x7eff100a9bf0 2022-05-02T09:42:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.710+0000 7eff14f9d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff100aff80 con 0x7eff101419c0 2022-05-02T09:42:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36260/0 (socket says 172.21.15.50:36260) 2022-05-02T09:42:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 -- 172.21.15.50:0/1310836859 learned_addr learned my addr 172.21.15.50:0/1310836859 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0ffff700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 0x7eff10150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0effd700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff100a9bf0 0x7eff100ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 -- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 msgr2=0x7eff10150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 0x7eff10150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 -- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff100a9bf0 msgr2=0x7eff100ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff100a9bf0 0x7eff100ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.711+0000 7eff0f7fe700 1 -- 172.21.15.50:0/1310836859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000092a0 con 0x7eff100636c0 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.712+0000 7eff0ffff700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 0x7eff10150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.712+0000 7eff0f7fe700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff0000ea20 tx=0x7eff00009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.712+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000ee60 con 0x7eff100636c0 2022-05-02T09:42:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.712+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000c850 con 0x7eff100636c0 2022-05-02T09:42:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.712+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000cbd0 con 0x7eff100636c0 2022-05-02T09:42:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.713+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff040092a0 con 0x7eff100636c0 2022-05-02T09:42:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.713+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1014de50 con 0x7eff100636c0 2022-05-02T09:42:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.714+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7eff00019030 con 0x7eff100636c0 2022-05-02T09:42:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.714+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff100a6ca0 con 0x7eff100636c0 2022-05-02T09:42:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.715+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7eff00061420 con 0x7eff100636c0 2022-05-02T09:42:26.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.719+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7eff00037e10 con 0x7eff100636c0 2022-05-02T09:42:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.739+0000 7f8b8b3ff700 1 Processor -- start 2022-05-02T09:42:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.739+0000 7f8b8b3ff700 1 -- start start 2022-05-02T09:42:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8b3ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b840ae040 0x7f8b840a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8b3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 0x7f8b84148b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8b3ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b84067720 con 0x7f8b84067350 2022-05-02T09:42:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8b3ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b84067ae0 con 0x7f8b840ae040 2022-05-02T09:42:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8b3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840ae770 con 0x7f8b84146770 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.740+0000 7f8b8999c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 0x7f8b84148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8999c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 0x7f8b84148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50816/0 (socket says 172.21.15.50:50816) 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8999c700 1 -- 172.21.15.50:0/3039500216 learned_addr learned my addr 172.21.15.50:0/3039500216 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8919b700 1 --1- 172.21.15.50:0/3039500216 >> v1:172.21.15.50:6789/0 conn(0x7f8b84067350 0x7f8b840a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52454/0 (socket says 172.21.15.50:52454) 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8899a700 1 --2- 172.21.15.50:0/3039500216 >> v2:172.21.15.50:3300/0 conn(0x7f8b840ae040 0x7f8b840a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8899a700 1 -- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 msgr2=0x7f8b84148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8899a700 1 --2- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 0x7f8b84148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8899a700 1 -- 172.21.15.50:0/3039500216 >> v1:172.21.15.50:6789/0 conn(0x7f8b84067350 legacy=0x7f8b840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.741+0000 7f8b8899a700 1 -- 172.21.15.50:0/3039500216 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8406e190 con 0x7f8b840ae040 2022-05-02T09:42:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.742+0000 7f8b8899a700 1 --2- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b840a1a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009760 tx=0x7f8b74009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b769a3b81365bb4 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.742+0000 7f8b73fff700 1 -- 172.21.15.50:0/3039500216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011630 con 0x7f8b840ae040 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.742+0000 7f8b73fff700 1 -- 172.21.15.50:0/3039500216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74011790 con 0x7f8b840ae040 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.742+0000 7f8b73fff700 1 -- 172.21.15.50:0/3039500216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011b50 con 0x7f8b840ae040 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 msgr2=0x7f8b840a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b840a1a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009760 tx=0x7f8b74009060 comp rx=0 tx=0).stop 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/3039500216 shutdown_connections 2022-05-02T09:42:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84146770 0x7f8b84148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/3039500216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b840a1a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/3039500216 >> 172.21.15.50:0/3039500216 conn(0x7f8b84062df0 msgr2=0x7f8b840631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/3039500216 shutdown_connections 2022-05-02T09:42:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.743+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/3039500216 wait complete. 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.745+0000 7f8b8b3ff700 1 Processor -- start 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.745+0000 7f8b8b3ff700 1 -- start start 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b84145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8b84146770 0x7f8b84145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8409c6a0 con 0x7f8b840ae040 2022-05-02T09:42:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84146620 con 0x7f8b84067350 2022-05-02T09:42:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8b3ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8409dbb0 con 0x7f8b84146770 2022-05-02T09:42:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8919b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8919b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50818/0 (socket says 172.21.15.50:50818) 2022-05-02T09:42:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.746+0000 7f8b8919b700 1 -- 172.21.15.50:0/4285106488 learned_addr learned my addr 172.21.15.50:0/4285106488 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8999c700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8b84146770 0x7f8b84145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8899a700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b84145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8919b700 1 -- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8b84146770 msgr2=0x7f8b84145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8919b700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8b84146770 0x7f8b84145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8919b700 1 -- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 msgr2=0x7f8b84145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8919b700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b84145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.747+0000 7f8b8919b700 1 -- 172.21.15.50:0/4285106488 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740092a0 con 0x7f8b84067350 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b8919b700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b80007fd0 tx=0x7f8b80007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800072e0 con 0x7f8b84067350 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80007440 con 0x7f8b84067350 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800048c0 con 0x7f8b84067350 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8409e2a0 con 0x7f8b84067350 2022-05-02T09:42:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.748+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8409e7d0 con 0x7f8b84067350 2022-05-02T09:42:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.750+0000 7fba1899d700 1 Processor -- start 2022-05-02T09:42:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.750+0000 7fba1899d700 1 -- start start 2022-05-02T09:42:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.750+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f8b80010070 con 0x7f8b84067350 2022-05-02T09:42:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.750+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8409e9f0 con 0x7f8b84067350 2022-05-02T09:42:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba1899d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba1899d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba1406f540 0x7fba141450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba1899d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1406f110 con 0x7fba1413dd40 2022-05-02T09:42:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba1899d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140b0690 con 0x7fba1406f540 2022-05-02T09:42:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba1899d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba140a4d50 con 0x7fba140b02c0 2022-05-02T09:42:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f8b80058a50 con 0x7f8b84067350 2022-05-02T09:42:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.751+0000 7fba137fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50128/0 (socket says 172.21.15.50:50128) 2022-05-02T09:42:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 -- 172.21.15.50:0/1600688 learned_addr learned my addr 172.21.15.50:0/1600688 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 -- 172.21.15.50:0/1600688 >> v2:172.21.15.50:3300/0 conn(0x7fba1406f540 msgr2=0x7fba141450e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 --2- 172.21.15.50:0/1600688 >> v2:172.21.15.50:3300/0 conn(0x7fba1406f540 0x7fba141450e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 -- 172.21.15.50:0/1600688 >> v1:172.21.15.50:6789/0 conn(0x7fba1413dd40 legacy=0x7fba140a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 -- 172.21.15.50:0/1600688 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1413e1d0 con 0x7fba140b02c0 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.752+0000 7fba137fe700 1 --2- 172.21.15.50:0/1600688 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba0c006fd0 tx=0x7fba0c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94cda3aebe3641c4 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.753+0000 7fba127fc700 1 -- 172.21.15.50:0/1600688 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c011630 con 0x7fba140b02c0 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.753+0000 7fba127fc700 1 -- 172.21.15.50:0/1600688 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c011790 con 0x7fba140b02c0 2022-05-02T09:42:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.753+0000 7fba127fc700 1 -- 172.21.15.50:0/1600688 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c011b50 con 0x7fba140b02c0 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 -- 172.21.15.50:0/1600688 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 msgr2=0x7fba140a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 --2- 172.21.15.50:0/1600688 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba0c006fd0 tx=0x7fba0c0090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 -- 172.21.15.50:0/1600688 shutdown_connections 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 --2- 172.21.15.50:0/1600688 >> v2:172.21.15.50:3300/0 conn(0x7fba1406f540 0x7fba141450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 --2- 172.21.15.50:0/1600688 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba140b02c0 0x7fba140a1ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 -- 172.21.15.50:0/1600688 >> 172.21.15.50:0/1600688 conn(0x7fba140638c0 msgr2=0x7fba140af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 -- 172.21.15.50:0/1600688 shutdown_connections 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.754+0000 7fba1899d700 1 -- 172.21.15.50:0/1600688 wait complete. 2022-05-02T09:42:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.756+0000 7fba1899d700 1 Processor -- start 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.756+0000 7fba1899d700 1 -- start start 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 0x7fba1414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba140b02c0 0x7fba14099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 0x7fba140ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1414e010 con 0x7fba1413dd40 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1414e230 con 0x7fba140b02c0 2022-05-02T09:42:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba1899d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1414e4a0 con 0x7fba1406f540 2022-05-02T09:42:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f8b80037980 con 0x7f8b84067350 2022-05-02T09:42:26.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba12ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba140b02c0 0x7fba14099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.764 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba137fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 0x7fba1414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 0x7fba140ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba137fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 0x7fba1414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50130/0 (socket says 172.21.15.50:50130) 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.757+0000 7fba137fe700 1 -- 172.21.15.50:0/3374826021 learned_addr learned my addr 172.21.15.50:0/3374826021 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7fba13fff700 1 -- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 msgr2=0x7fba1414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7fba13fff700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 0x7fba1414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7fba13fff700 1 -- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba140b02c0 msgr2=0x7fba14099b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7fba13fff700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba140b02c0 0x7fba14099b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.758+0000 7fba13fff700 1 -- 172.21.15.50:0/3374826021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c009370 con 0x7fba1413dd40 2022-05-02T09:42:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba13fff700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 0x7fba140ab930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba0400b810 tx=0x7fba040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04011630 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040117b0 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14098810 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04011b70 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.759+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba14097440 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.761+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14098a30 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.761+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fba04021070 con 0x7fba1413dd40 2022-05-02T09:42:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.762+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fba040595b0 con 0x7fba1413dd40 2022-05-02T09:42:26.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.767+0000 7fddd579d700 1 Processor -- start 2022-05-02T09:42:26.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.767+0000 7fddd579d700 1 -- start start 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd579d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd579d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddd00a6200 0x7fddd013e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd579d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd0140ff0 con 0x7fddd00636c0 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd579d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0063a90 con 0x7fddd00a6200 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd579d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00a9200 con 0x7fddd00a9bf0 2022-05-02T09:42:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddcf7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.768+0000 7fddd4f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddd00a6200 0x7fddd013e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddcf7fe700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50132/0 (socket says 172.21.15.50:50132) 2022-05-02T09:42:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddd4f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddd00a6200 0x7fddd013e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36268/0 (socket says 172.21.15.50:36268) 2022-05-02T09:42:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddcf7fe700 1 -- 172.21.15.50:0/3820847859 learned_addr learned my addr 172.21.15.50:0/3820847859 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddd4f9c700 1 -- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 msgr2=0x7fddd013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddd4f9c700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddd4f9c700 1 -- 172.21.15.50:0/3820847859 >> v1:172.21.15.50:6789/0 conn(0x7fddd00636c0 legacy=0x7fddd0141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddd4f9c700 1 -- 172.21.15.50:0/3820847859 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0141e50 con 0x7fddd00a6200 2022-05-02T09:42:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fddcf7fe700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:26.774 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.769+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fba14098a30 con 0x7fba1413dd40 2022-05-02T09:42:26.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.770+0000 7fddd4f9c700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a6200 0x7fddd013e540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009e60 tx=0x7fddc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1065d4d4d958d70b server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.770+0000 7fddceffd700 1 -- 172.21.15.50:0/3820847859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800e070 con 0x7fddd00a6200 2022-05-02T09:42:26.775 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.770+0000 7fddceffd700 1 -- 172.21.15.50:0/3820847859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800bbf0 con 0x7fddd00a6200 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.770+0000 7fddceffd700 1 -- 172.21.15.50:0/3820847859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8012430 con 0x7fddd00a6200 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 -- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a6200 msgr2=0x7fddd013e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a6200 0x7fddd013e540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009e60 tx=0x7fddc8009780 comp rx=0 tx=0).stop 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 -- 172.21.15.50:0/3820847859 shutdown_connections 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a6200 0x7fddd013e540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 --2- 172.21.15.50:0/3820847859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00a9bf0 0x7fddd013e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 -- 172.21.15.50:0/3820847859 >> 172.21.15.50:0/3820847859 conn(0x7fddd0069370 msgr2=0x7fddd0062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 -- 172.21.15.50:0/3820847859 shutdown_connections 2022-05-02T09:42:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.771+0000 7fddd579d700 1 -- 172.21.15.50:0/3820847859 wait complete. 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.774+0000 7fddd579d700 1 Processor -- start 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.774+0000 7fddd579d700 1 -- start start 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 0x7fddd014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 0x7fddd00b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a9bf0 0x7fddd014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd014e0a0 con 0x7fddd00a9bf0 2022-05-02T09:42:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd014e2c0 con 0x7fddd00a6200 2022-05-02T09:42:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.775+0000 7fddd579d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd014e530 con 0x7fddd00636c0 2022-05-02T09:42:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 0x7fddd014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 0x7fddd014db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50134/0 (socket says 172.21.15.50:50134) 2022-05-02T09:42:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcffff700 1 -- 172.21.15.50:0/1005479191 learned_addr learned my addr 172.21.15.50:0/1005479191 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddd4f9c700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a9bf0 0x7fddd014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 0x7fddd00b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 -- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 msgr2=0x7fddd014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 0x7fddd014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 -- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a9bf0 msgr2=0x7fddd014b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a9bf0 0x7fddd014b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.776+0000 7fddcf7fe700 1 -- 172.21.15.50:0/1005479191 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009370 con 0x7fddd00a6200 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.777+0000 7fddcf7fe700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 0x7fddd00b0680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddd006a070 tx=0x7fddc40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.777+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4013680 con 0x7fddd00a6200 2022-05-02T09:42:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.777+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40137e0 con 0x7fddd00a6200 2022-05-02T09:42:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.777+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4013b80 con 0x7fddd00a6200 2022-05-02T09:42:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.777+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8009a20 con 0x7fddd00a6200 2022-05-02T09:42:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.778+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd00ad2e0 con 0x7fddd00a6200 2022-05-02T09:42:26.783 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.779+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd00a8980 con 0x7fddd00a6200 2022-05-02T09:42:26.783 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.780+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fddc4019030 con 0x7fddd00a6200 2022-05-02T09:42:26.783 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.781+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fddc4059860 con 0x7fddd00a6200 2022-05-02T09:42:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.788+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fddc40385c0 con 0x7fddd00a6200 2022-05-02T09:42:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.906+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff100aa0f0 con 0x7eff100636c0 2022-05-02T09:42:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.907+0000 7efef77fe700 1 -- 172.21.15.50:0/1310836859 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff0003b600 con 0x7eff100636c0 2022-05-02T09:42:26.909 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:26.911 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 >> v1:172.21.15.50:6800/36423 conn(0x7efef0044b40 legacy=0x7efef0046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 msgr2=0x7eff10096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff0000ea20 tx=0x7eff00009060 comp rx=0 tx=0).stop 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 shutdown_connections 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7eff101419c0 0x7eff10150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100636c0 0x7eff10096a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 --2- 172.21.15.50:0/1310836859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff100a9bf0 0x7eff100ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 >> 172.21.15.50:0/1310836859 conn(0x7eff10069370 msgr2=0x7eff100a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 shutdown_connections 2022-05-02T09:42:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.909+0000 7eff14f9d700 1 -- 172.21.15.50:0/1310836859 wait complete. 2022-05-02T09:42:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.929+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b8404bfb0 con 0x7f8b84067350 2022-05-02T09:42:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.930+0000 7f8b717fa700 1 -- 172.21.15.50:0/4285106488 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b8003afa0 con 0x7f8b84067350 2022-05-02T09:42:26.933 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 >> v1:172.21.15.50:6800/36423 conn(0x7f8b64044b70 legacy=0x7f8b64047020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 msgr2=0x7f8b8409d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b80007fd0 tx=0x7f8b80007df0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 shutdown_connections 2022-05-02T09:42:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8b84146770 0x7f8b84145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b84067350 0x7f8b8409d1b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 --2- 172.21.15.50:0/4285106488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840ae040 0x7f8b84145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 >> 172.21.15.50:0/4285106488 conn(0x7f8b84062df0 msgr2=0x7f8b840b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 shutdown_connections 2022-05-02T09:42:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.933+0000 7f8b8b3ff700 1 -- 172.21.15.50:0/4285106488 wait complete. 2022-05-02T09:42:26.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986181 for osd.3 2022-05-02T09:42:26.940 DEBUG:teuthology.parallel:result is None 2022-05-02T09:42:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.948+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba14098a00 con 0x7fba1413dd40 2022-05-02T09:42:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.948+0000 7fba0b7fe700 1 -- 172.21.15.50:0/3374826021 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba04015030 con 0x7fba1413dd40 2022-05-02T09:42:26.951 INFO:teuthology.orchestra.run.smithi050.stdout:133143986181 2022-05-02T09:42:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.950+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 >> v1:172.21.15.50:6800/36423 conn(0x7fb9f8044b40 legacy=0x7fb9f8046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.950+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 msgr2=0x7fba140ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.950+0000 7fba1899d700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 0x7fba140ab930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba0400b810 tx=0x7fba040091d0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 shutdown_connections 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fba1406f540 0x7fba1414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1413dd40 0x7fba140ab930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 --2- 172.21.15.50:0/3374826021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fba140b02c0 0x7fba14099b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 >> 172.21.15.50:0/3374826021 conn(0x7fba140638c0 msgr2=0x7fba14139900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 shutdown_connections 2022-05-02T09:42:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.951+0000 7fba1899d700 1 -- 172.21.15.50:0/3374826021 wait complete. 2022-05-02T09:42:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.953+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddd00b35b0 con 0x7fddd00a6200 2022-05-02T09:42:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.953+0000 7fddb7fff700 1 -- 172.21.15.50:0/1005479191 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddc403bdb0 con 0x7fddd00a6200 2022-05-02T09:42:26.957 INFO:teuthology.orchestra.run.smithi050.stdout:124554051589 2022-05-02T09:42:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 >> v1:172.21.15.50:6800/36423 conn(0x7fddb0044b40 legacy=0x7fddb0046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 msgr2=0x7fddd00b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 0x7fddd00b0680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddd006a070 tx=0x7fddc40090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 shutdown_connections 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fddd00636c0 0x7fddd014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd00a9bf0 0x7fddd014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 --2- 172.21.15.50:0/1005479191 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fddd00a6200 0x7fddd00b0680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.956+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 >> 172.21.15.50:0/1005479191 conn(0x7fddd0069370 msgr2=0x7fddd013abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.957+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 shutdown_connections 2022-05-02T09:42:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:26.957+0000 7fddd579d700 1 -- 172.21.15.50:0/1005479191 wait complete. 2022-05-02T09:42:26.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986181 for osd.2 2022-05-02T09:42:26.962 DEBUG:teuthology.parallel:result is None 2022-05-02T09:42:26.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986181 got 133143986181 for osd.1 2022-05-02T09:42:26.981 DEBUG:teuthology.parallel:result is None 2022-05-02T09:42:26.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051589 got 124554051589 for osd.0 2022-05-02T09:42:26.985 DEBUG:teuthology.parallel:result is None 2022-05-02T09:42:26.985 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-05-02T09:42:26.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:42:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.251+0000 7f9d84bff700 1 Processor -- start 2022-05-02T09:42:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.252+0000 7f9d84bff700 1 -- start start 2022-05-02T09:42:27.255 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d84bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 0x7f9d801414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d84bff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d801419e0 0x7f9d80148540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d84bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800a7c30 con 0x7f9d800704b0 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d84bff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d80070880 con 0x7f9d801419e0 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d84bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800aae20 con 0x7f9d800a8660 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d7e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d800704b0 0x7f9d800abba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52460/0 (socket says 172.21.15.50:52460) 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d7e59c700 1 -- 172.21.15.50:0/1433454995 learned_addr learned my addr 172.21.15.50:0/1433454995 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d7ed9d700 1 --2- 172.21.15.50:0/1433454995 >> v2:172.21.15.50:3300/0 conn(0x7f9d801419e0 0x7f9d80148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.253+0000 7f9d7dd9b700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 0x7f9d801414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7d59a700 1 -- 172.21.15.50:0/1433454995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971989139 0 0) 0x7f9d800a7c30 con 0x7f9d800704b0 2022-05-02T09:42:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7ed9d700 1 -- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 msgr2=0x7f9d801414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7ed9d700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 0x7f9d801414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7ed9d700 1 -- 172.21.15.50:0/1433454995 >> v1:172.21.15.50:6789/0 conn(0x7f9d800704b0 legacy=0x7f9d800abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7ed9d700 1 -- 172.21.15.50:0/1433454995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80141200 con 0x7f9d801419e0 2022-05-02T09:42:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7dd9b700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 0x7f9d801414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.254+0000 7f9d7ed9d700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d80148540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009e60 tx=0x7f9d78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a858d05220e18 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:27.259 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.257+0000 7f9d7d59a700 1 -- 172.21.15.50:0/1433454995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800e070 con 0x7f9d801419e0 2022-05-02T09:42:27.259 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.257+0000 7f9d7d59a700 1 -- 172.21.15.50:0/1433454995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800bb60 con 0x7f9d801419e0 2022-05-02T09:42:27.260 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.257+0000 7f9d7d59a700 1 -- 172.21.15.50:0/1433454995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78012430 con 0x7f9d801419e0 2022-05-02T09:42:27.260 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 -- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 msgr2=0x7f9d80148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.260 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d80148540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009e60 tx=0x7f9d78009780 comp rx=0 tx=0).stop 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 -- 172.21.15.50:0/1433454995 shutdown_connections 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d80148540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1433454995 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800a8660 0x7f9d801414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 -- 172.21.15.50:0/1433454995 >> 172.21.15.50:0/1433454995 conn(0x7f9d8006b010 msgr2=0x7f9d80067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 -- 172.21.15.50:0/1433454995 shutdown_connections 2022-05-02T09:42:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.258+0000 7f9d84bff700 1 -- 172.21.15.50:0/1433454995 wait complete. 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.259+0000 7f9d84bff700 1 Processor -- start 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 -- start start 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 0x7f9d800a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d801508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8006e890 con 0x7f9d801419e0 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8006d1c0 con 0x7f9d800a8660 2022-05-02T09:42:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.260+0000 7f9d84bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8009b960 con 0x7f9d800704b0 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7e59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 0x7f9d800a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7e59c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50138/0 (socket says 172.21.15.50:50138) 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7e59c700 1 -- 172.21.15.50:0/1675864529 learned_addr learned my addr 172.21.15.50:0/1675864529 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7ed9d700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d801508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 -- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 msgr2=0x7f9d8009b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 -- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 msgr2=0x7f9d801508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d801508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7dd9b700 1 -- 172.21.15.50:0/1675864529 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740092a0 con 0x7f9d800a8660 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.261+0000 7f9d7e59c700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d7dd9b700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 0x7f9d800a6880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400e950 tx=0x7f9d74009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74009580 con 0x7f9d800a8660 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74013680 con 0x7f9d800a8660 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74013a40 con 0x7f9d800a8660 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d78009a20 con 0x7f9d800a8660 2022-05-02T09:42:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.262+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d800a45e0 con 0x7f9d800a8660 2022-05-02T09:42:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.263+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8004bfb0 con 0x7f9d800a8660 2022-05-02T09:42:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.264+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f9d74019030 con 0x7f9d800a8660 2022-05-02T09:42:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.264+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9d74059800 con 0x7f9d800a8660 2022-05-02T09:42:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.268+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f9d740387c0 con 0x7f9d800a8660 2022-05-02T09:42:27.424 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.421+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 --> v1:172.21.15.50:6800/36423 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d800aa320 con 0x7f9d5c044b40 2022-05-02T09:42:27.432 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.430+0000 7f9d6e7fc700 1 -- 172.21.15.50:0/1675864529 <== mgr.14098 v1:172.21.15.50:6800/36423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269569 (unknown 2965378022 0 2099309543) 0x7f9d800aa320 con 0x7f9d5c044b40 2022-05-02T09:42:27.437 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 >> v1:172.21.15.50:6800/36423 conn(0x7f9d5c044b40 legacy=0x7f9d5c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 msgr2=0x7f9d800a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 0x7f9d800a6880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400e950 tx=0x7f9d74009060 comp rx=0 tx=0).stop 2022-05-02T09:42:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 shutdown_connections 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f9d800704b0 0x7f9d8009b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d801419e0 0x7f9d801508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 --2- 172.21.15.50:0/1675864529 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9d800a8660 0x7f9d800a6880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 >> 172.21.15.50:0/1675864529 conn(0x7f9d8006b010 msgr2=0x7f9d8013fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 shutdown_connections 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.434+0000 7f9d84bff700 1 -- 172.21.15.50:0/1675864529 wait complete. 2022-05-02T09:42:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:42:27.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2022-05-02T09:42:25.583823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599149,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":136,"num_read_kb":125,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":46464,"kb_used_data":2592,"kb_used_omap":46,"kb_used_meta":43793,"kb_avail":377440896,"statfs":{"total":386547056640,"available":386499477504,"internally_reserved":0,"allocated":2654208,"data_stored":1792562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47594,"internal_metadata":44844566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.360254"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234819+0000","last_change":"2022-05-02T09:42:11.156252+0000","last_active":"2022-05-02T09:42:22.234819+0000","last_peered":"2022-05-02T09:42:22.234819+0000","last_clean":"2022-05-02T09:42:22.234819+0000","last_became_active":"2022-05-02T09:42:11.151643+0000","last_became_peered":"2022-05-02T09:42:11.151643+0000","last_unstale":"2022-05-02T09:42:22.234819+0000","last_undegraded":"2022-05-02T09:42:22.234819+0000","last_fullsized":"2022-05-02T09:42:22.234819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:21:13.551818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234309+0000","last_change":"2022-05-02T09:42:11.145724+0000","last_active":"2022-05-02T09:42:22.234309+0000","last_peered":"2022-05-02T09:42:22.234309+0000","last_clean":"2022-05-02T09:42:22.234309+0000","last_became_active":"2022-05-02T09:42:11.145372+0000","last_became_peered":"2022-05-02T09:42:11.145372+0000","last_unstale":"2022-05-02T09:42:22.234309+0000","last_undegraded":"2022-05-02T09:42:22.234309+0000","last_fullsized":"2022-05-02T09:42:22.234309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:04:30.356588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267305+0000","last_change":"2022-05-02T09:42:11.154782+0000","last_active":"2022-05-02T09:42:22.267305+0000","last_peered":"2022-05-02T09:42:22.267305+0000","last_clean":"2022-05-02T09:42:22.267305+0000","last_became_active":"2022-05-02T09:42:11.154267+0000","last_became_peered":"2022-05-02T09:42:11.154267+0000","last_unstale":"2022-05-02T09:42:22.267305+0000","last_undegraded":"2022-05-02T09:42:22.267305+0000","last_fullsized":"2022-05-02T09:42:22.267305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:19:56.995375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267062+0000","last_change":"2022-05-02T09:42:11.150154+0000","last_active":"2022-05-02T09:42:22.267062+0000","last_peered":"2022-05-02T09:42:22.267062+0000","last_clean":"2022-05-02T09:42:22.267062+0000","last_became_active":"2022-05-02T09:42:11.149798+0000","last_became_peered":"2022-05-02T09:42:11.149798+0000","last_unstale":"2022-05-02T09:42:22.267062+0000","last_undegraded":"2022-05-02T09:42:22.267062+0000","last_fullsized":"2022-05-02T09:42:22.267062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:55:31.986532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266733+0000","last_change":"2022-05-02T09:42:11.180791+0000","last_active":"2022-05-02T09:42:22.266733+0000","last_peered":"2022-05-02T09:42:22.266733+0000","last_clean":"2022-05-02T09:42:22.266733+0000","last_became_active":"2022-05-02T09:42:11.180378+0000","last_became_peered":"2022-05-02T09:42:11.180378+0000","last_unstale":"2022-05-02T09:42:22.266733+0000","last_undegraded":"2022-05-02T09:42:22.266733+0000","last_fullsized":"2022-05-02T09:42:22.266733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:23:18.941143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235200+0000","last_change":"2022-05-02T09:42:11.149822+0000","last_active":"2022-05-02T09:42:22.235200+0000","last_peered":"2022-05-02T09:42:22.235200+0000","last_clean":"2022-05-02T09:42:22.235200+0000","last_became_active":"2022-05-02T09:42:11.145645+0000","last_became_peered":"2022-05-02T09:42:11.145645+0000","last_unstale":"2022-05-02T09:42:22.235200+0000","last_undegraded":"2022-05-02T09:42:22.235200+0000","last_fullsized":"2022-05-02T09:42:22.235200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:34:25.925032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233828+0000","last_change":"2022-05-02T09:42:11.163438+0000","last_active":"2022-05-02T09:42:22.233828+0000","last_peered":"2022-05-02T09:42:22.233828+0000","last_clean":"2022-05-02T09:42:22.233828+0000","last_became_active":"2022-05-02T09:42:11.159963+0000","last_became_peered":"2022-05-02T09:42:11.159963+0000","last_unstale":"2022-05-02T09:42:22.233828+0000","last_undegraded":"2022-05-02T09:42:22.233828+0000","last_fullsized":"2022-05-02T09:42:22.233828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:08:09.761710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265746+0000","last_change":"2022-05-02T09:42:11.153815+0000","last_active":"2022-05-02T09:42:22.265746+0000","last_peered":"2022-05-02T09:42:22.265746+0000","last_clean":"2022-05-02T09:42:22.265746+0000","last_became_active":"2022-05-02T09:42:11.152263+0000","last_became_peered":"2022-05-02T09:42:11.152263+0000","last_unstale":"2022-05-02T09:42:22.265746+0000","last_undegraded":"2022-05-02T09:42:22.265746+0000","last_fullsized":"2022-05-02T09:42:22.265746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:03:31.072418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267838+0000","last_change":"2022-05-02T09:42:11.180999+0000","last_active":"2022-05-02T09:42:22.267838+0000","last_peered":"2022-05-02T09:42:22.267838+0000","last_clean":"2022-05-02T09:42:22.267838+0000","last_became_active":"2022-05-02T09:42:11.180544+0000","last_became_peered":"2022-05-02T09:42:11.180544+0000","last_unstale":"2022-05-02T09:42:22.267838+0000","last_undegraded":"2022-05-02T09:42:22.267838+0000","last_fullsized":"2022-05-02T09:42:22.267838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:28:23.768964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266161+0000","last_change":"2022-05-02T09:42:11.153463+0000","last_active":"2022-05-02T09:42:22.266161+0000","last_peered":"2022-05-02T09:42:22.266161+0000","last_clean":"2022-05-02T09:42:22.266161+0000","last_became_active":"2022-05-02T09:42:11.152403+0000","last_became_peered":"2022-05-02T09:42:11.152403+0000","last_unstale":"2022-05-02T09:42:22.266161+0000","last_undegraded":"2022-05-02T09:42:22.266161+0000","last_fullsized":"2022-05-02T09:42:22.266161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:43:48.199163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266573+0000","last_change":"2022-05-02T09:42:11.157828+0000","last_active":"2022-05-02T09:42:22.266573+0000","last_peered":"2022-05-02T09:42:22.266573+0000","last_clean":"2022-05-02T09:42:22.266573+0000","last_became_active":"2022-05-02T09:42:11.153120+0000","last_became_peered":"2022-05-02T09:42:11.153120+0000","last_unstale":"2022-05-02T09:42:22.266573+0000","last_undegraded":"2022-05-02T09:42:22.266573+0000","last_fullsized":"2022-05-02T09:42:22.266573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:59:09.978347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235829+0000","last_change":"2022-05-02T09:42:11.141726+0000","last_active":"2022-05-02T09:42:22.235829+0000","last_peered":"2022-05-02T09:42:22.235829+0000","last_clean":"2022-05-02T09:42:22.235829+0000","last_became_active":"2022-05-02T09:42:11.141421+0000","last_became_peered":"2022-05-02T09:42:11.141421+0000","last_unstale":"2022-05-02T09:42:22.235829+0000","last_undegraded":"2022-05-02T09:42:22.235829+0000","last_fullsized":"2022-05-02T09:42:22.235829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:54:36.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234297+0000","last_change":"2022-05-02T09:42:11.147746+0000","last_active":"2022-05-02T09:42:22.234297+0000","last_peered":"2022-05-02T09:42:22.234297+0000","last_clean":"2022-05-02T09:42:22.234297+0000","last_became_active":"2022-05-02T09:42:11.143406+0000","last_became_peered":"2022-05-02T09:42:11.143406+0000","last_unstale":"2022-05-02T09:42:22.234297+0000","last_undegraded":"2022-05-02T09:42:22.234297+0000","last_fullsized":"2022-05-02T09:42:22.234297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:49:19.866673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265901+0000","last_change":"2022-05-02T09:42:11.161411+0000","last_active":"2022-05-02T09:42:22.265901+0000","last_peered":"2022-05-02T09:42:22.265901+0000","last_clean":"2022-05-02T09:42:22.265901+0000","last_became_active":"2022-05-02T09:42:11.160615+0000","last_became_peered":"2022-05-02T09:42:11.160615+0000","last_unstale":"2022-05-02T09:42:22.265901+0000","last_undegraded":"2022-05-02T09:42:22.265901+0000","last_fullsized":"2022-05-02T09:42:22.265901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:53:43.703274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266445+0000","last_change":"2022-05-02T09:42:11.142366+0000","last_active":"2022-05-02T09:42:22.266445+0000","last_peered":"2022-05-02T09:42:22.266445+0000","last_clean":"2022-05-02T09:42:22.266445+0000","last_became_active":"2022-05-02T09:42:11.142053+0000","last_became_peered":"2022-05-02T09:42:11.142053+0000","last_unstale":"2022-05-02T09:42:22.266445+0000","last_undegraded":"2022-05-02T09:42:22.266445+0000","last_fullsized":"2022-05-02T09:42:22.266445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:33:10.753385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232958+0000","last_change":"2022-05-02T09:42:11.131814+0000","last_active":"2022-05-02T09:42:22.232958+0000","last_peered":"2022-05-02T09:42:22.232958+0000","last_clean":"2022-05-02T09:42:22.232958+0000","last_became_active":"2022-05-02T09:42:11.131514+0000","last_became_peered":"2022-05-02T09:42:11.131514+0000","last_unstale":"2022-05-02T09:42:22.232958+0000","last_undegraded":"2022-05-02T09:42:22.232958+0000","last_fullsized":"2022-05-02T09:42:22.232958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:14:43.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267960+0000","last_change":"2022-05-02T09:42:11.181581+0000","last_active":"2022-05-02T09:42:22.267960+0000","last_peered":"2022-05-02T09:42:22.267960+0000","last_clean":"2022-05-02T09:42:22.267960+0000","last_became_active":"2022-05-02T09:42:11.181302+0000","last_became_peered":"2022-05-02T09:42:11.181302+0000","last_unstale":"2022-05-02T09:42:22.267960+0000","last_undegraded":"2022-05-02T09:42:22.267960+0000","last_fullsized":"2022-05-02T09:42:22.267960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:20:35.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266753+0000","last_change":"2022-05-02T09:42:11.163743+0000","last_active":"2022-05-02T09:42:22.266753+0000","last_peered":"2022-05-02T09:42:22.266753+0000","last_clean":"2022-05-02T09:42:22.266753+0000","last_became_active":"2022-05-02T09:42:11.163439+0000","last_became_peered":"2022-05-02T09:42:11.163439+0000","last_unstale":"2022-05-02T09:42:22.266753+0000","last_undegraded":"2022-05-02T09:42:22.266753+0000","last_fullsized":"2022-05-02T09:42:22.266753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:05:11.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234458+0000","last_change":"2022-05-02T09:42:11.155107+0000","last_active":"2022-05-02T09:42:22.234458+0000","last_peered":"2022-05-02T09:42:22.234458+0000","last_clean":"2022-05-02T09:42:22.234458+0000","last_became_active":"2022-05-02T09:42:11.154333+0000","last_became_peered":"2022-05-02T09:42:11.154333+0000","last_unstale":"2022-05-02T09:42:22.234458+0000","last_undegraded":"2022-05-02T09:42:22.234458+0000","last_fullsized":"2022-05-02T09:42:22.234458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:50:36.592256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266491+0000","last_change":"2022-05-02T09:42:11.137878+0000","last_active":"2022-05-02T09:42:22.266491+0000","last_peered":"2022-05-02T09:42:22.266491+0000","last_clean":"2022-05-02T09:42:22.266491+0000","last_became_active":"2022-05-02T09:42:11.137587+0000","last_became_peered":"2022-05-02T09:42:11.137587+0000","last_unstale":"2022-05-02T09:42:22.266491+0000","last_undegraded":"2022-05-02T09:42:22.266491+0000","last_fullsized":"2022-05-02T09:42:22.266491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T09:50:06.643669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266001+0000","last_change":"2022-05-02T09:42:11.161114+0000","last_active":"2022-05-02T09:42:22.266001+0000","last_peered":"2022-05-02T09:42:22.266001+0000","last_clean":"2022-05-02T09:42:22.266001+0000","last_became_active":"2022-05-02T09:42:11.160754+0000","last_became_peered":"2022-05-02T09:42:11.160754+0000","last_unstale":"2022-05-02T09:42:22.266001+0000","last_undegraded":"2022-05-02T09:42:22.266001+0000","last_fullsized":"2022-05-02T09:42:22.266001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:38:15.157653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266288+0000","last_change":"2022-05-02T09:42:11.138596+0000","last_active":"2022-05-02T09:42:22.266288+0000","last_peered":"2022-05-02T09:42:22.266288+0000","last_clean":"2022-05-02T09:42:22.266288+0000","last_became_active":"2022-05-02T09:42:11.138304+0000","last_became_peered":"2022-05-02T09:42:11.138304+0000","last_unstale":"2022-05-02T09:42:22.266288+0000","last_undegraded":"2022-05-02T09:42:22.266288+0000","last_fullsized":"2022-05-02T09:42:22.266288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:34:24.897058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233000+0000","last_change":"2022-05-02T09:42:11.160929+0000","last_active":"2022-05-02T09:42:22.233000+0000","last_peered":"2022-05-02T09:42:22.233000+0000","last_clean":"2022-05-02T09:42:22.233000+0000","last_became_active":"2022-05-02T09:42:11.160306+0000","last_became_peered":"2022-05-02T09:42:11.160306+0000","last_unstale":"2022-05-02T09:42:22.233000+0000","last_undegraded":"2022-05-02T09:42:22.233000+0000","last_fullsized":"2022-05-02T09:42:22.233000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:31:56.914858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265605+0000","last_change":"2022-05-02T09:42:11.167545+0000","last_active":"2022-05-02T09:42:22.265605+0000","last_peered":"2022-05-02T09:42:22.265605+0000","last_clean":"2022-05-02T09:42:22.265605+0000","last_became_active":"2022-05-02T09:42:11.166875+0000","last_became_peered":"2022-05-02T09:42:11.166875+0000","last_unstale":"2022-05-02T09:42:22.265605+0000","last_undegraded":"2022-05-02T09:42:22.265605+0000","last_fullsized":"2022-05-02T09:42:22.265605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:29:59.177436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267096+0000","last_change":"2022-05-02T09:42:11.168881+0000","last_active":"2022-05-02T09:42:22.267096+0000","last_peered":"2022-05-02T09:42:22.267096+0000","last_clean":"2022-05-02T09:42:22.267096+0000","last_became_active":"2022-05-02T09:42:11.168197+0000","last_became_peered":"2022-05-02T09:42:11.168197+0000","last_unstale":"2022-05-02T09:42:22.267096+0000","last_undegraded":"2022-05-02T09:42:22.267096+0000","last_fullsized":"2022-05-02T09:42:22.267096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:18:58.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266487+0000","last_change":"2022-05-02T09:42:11.160921+0000","last_active":"2022-05-02T09:42:22.266487+0000","last_peered":"2022-05-02T09:42:22.266487+0000","last_clean":"2022-05-02T09:42:22.266487+0000","last_became_active":"2022-05-02T09:42:11.160324+0000","last_became_peered":"2022-05-02T09:42:11.160324+0000","last_unstale":"2022-05-02T09:42:22.266487+0000","last_undegraded":"2022-05-02T09:42:22.266487+0000","last_fullsized":"2022-05-02T09:42:22.266487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:45:49.403381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235713+0000","last_change":"2022-05-02T09:42:11.141985+0000","last_active":"2022-05-02T09:42:22.235713+0000","last_peered":"2022-05-02T09:42:22.235713+0000","last_clean":"2022-05-02T09:42:22.235713+0000","last_became_active":"2022-05-02T09:42:11.135147+0000","last_became_peered":"2022-05-02T09:42:11.135147+0000","last_unstale":"2022-05-02T09:42:22.235713+0000","last_undegraded":"2022-05-02T09:42:22.235713+0000","last_fullsized":"2022-05-02T09:42:22.235713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:14:32.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"35'2","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266142+0000","last_change":"2022-05-02T09:42:11.161873+0000","last_active":"2022-05-02T09:42:22.266142+0000","last_peered":"2022-05-02T09:42:22.266142+0000","last_clean":"2022-05-02T09:42:22.266142+0000","last_became_active":"2022-05-02T09:42:11.161081+0000","last_became_peered":"2022-05-02T09:42:11.161081+0000","last_unstale":"2022-05-02T09:42:22.266142+0000","last_undegraded":"2022-05-02T09:42:22.266142+0000","last_fullsized":"2022-05-02T09:42:22.266142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:00:42.184422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236122+0000","last_change":"2022-05-02T09:42:11.170335+0000","last_active":"2022-05-02T09:42:22.236122+0000","last_peered":"2022-05-02T09:42:22.236122+0000","last_clean":"2022-05-02T09:42:22.236122+0000","last_became_active":"2022-05-02T09:42:11.166918+0000","last_became_peered":"2022-05-02T09:42:11.166918+0000","last_unstale":"2022-05-02T09:42:22.236122+0000","last_undegraded":"2022-05-02T09:42:22.236122+0000","last_fullsized":"2022-05-02T09:42:22.236122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:38:06.142566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265736+0000","last_change":"2022-05-02T09:42:11.137964+0000","last_active":"2022-05-02T09:42:22.265736+0000","last_peered":"2022-05-02T09:42:22.265736+0000","last_clean":"2022-05-02T09:42:22.265736+0000","last_became_active":"2022-05-02T09:42:11.137281+0000","last_became_peered":"2022-05-02T09:42:11.137281+0000","last_unstale":"2022-05-02T09:42:22.265736+0000","last_undegraded":"2022-05-02T09:42:22.265736+0000","last_fullsized":"2022-05-02T09:42:22.265736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:19:19.251970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267106+0000","last_change":"2022-05-02T09:42:11.150934+0000","last_active":"2022-05-02T09:42:22.267106+0000","last_peered":"2022-05-02T09:42:22.267106+0000","last_clean":"2022-05-02T09:42:22.267106+0000","last_became_active":"2022-05-02T09:42:11.150285+0000","last_became_peered":"2022-05-02T09:42:11.150285+0000","last_unstale":"2022-05-02T09:42:22.267106+0000","last_undegraded":"2022-05-02T09:42:22.267106+0000","last_fullsized":"2022-05-02T09:42:22.267106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:57:23.186493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233362+0000","last_change":"2022-05-02T09:42:11.146037+0000","last_active":"2022-05-02T09:42:22.233362+0000","last_peered":"2022-05-02T09:42:22.233362+0000","last_clean":"2022-05-02T09:42:22.233362+0000","last_became_active":"2022-05-02T09:42:11.135507+0000","last_became_peered":"2022-05-02T09:42:11.135507+0000","last_unstale":"2022-05-02T09:42:22.233362+0000","last_undegraded":"2022-05-02T09:42:22.233362+0000","last_fullsized":"2022-05-02T09:42:22.233362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:06:49.638907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234576+0000","last_change":"2022-05-02T09:42:11.139575+0000","last_active":"2022-05-02T09:42:22.234576+0000","last_peered":"2022-05-02T09:42:22.234576+0000","last_clean":"2022-05-02T09:42:22.234576+0000","last_became_active":"2022-05-02T09:42:11.138741+0000","last_became_peered":"2022-05-02T09:42:11.138741+0000","last_unstale":"2022-05-02T09:42:22.234576+0000","last_undegraded":"2022-05-02T09:42:22.234576+0000","last_fullsized":"2022-05-02T09:42:22.234576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:09:58.179601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'8","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267906+0000","last_change":"2022-05-02T09:42:11.181189+0000","last_active":"2022-05-02T09:42:22.267906+0000","last_peered":"2022-05-02T09:42:22.267906+0000","last_clean":"2022-05-02T09:42:22.267906+0000","last_became_active":"2022-05-02T09:42:11.180631+0000","last_became_peered":"2022-05-02T09:42:11.180631+0000","last_unstale":"2022-05-02T09:42:22.267906+0000","last_undegraded":"2022-05-02T09:42:22.267906+0000","last_fullsized":"2022-05-02T09:42:22.267906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:55:49.201370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233263+0000","last_change":"2022-05-02T09:42:11.147467+0000","last_active":"2022-05-02T09:42:22.233263+0000","last_peered":"2022-05-02T09:42:22.233263+0000","last_clean":"2022-05-02T09:42:22.233263+0000","last_became_active":"2022-05-02T09:42:11.146915+0000","last_became_peered":"2022-05-02T09:42:11.146915+0000","last_unstale":"2022-05-02T09:42:22.233263+0000","last_undegraded":"2022-05-02T09:42:22.233263+0000","last_fullsized":"2022-05-02T09:42:22.233263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:11:26.060865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234132+0000","last_change":"2022-05-02T09:42:11.157177+0000","last_active":"2022-05-02T09:42:22.234132+0000","last_peered":"2022-05-02T09:42:22.234132+0000","last_clean":"2022-05-02T09:42:22.234132+0000","last_became_active":"2022-05-02T09:42:11.156863+0000","last_became_peered":"2022-05-02T09:42:11.156863+0000","last_unstale":"2022-05-02T09:42:22.234132+0000","last_undegraded":"2022-05-02T09:42:22.234132+0000","last_fullsized":"2022-05-02T09:42:22.234132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:00:52.784510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233730+0000","last_change":"2022-05-02T09:42:11.160362+0000","last_active":"2022-05-02T09:42:22.233730+0000","last_peered":"2022-05-02T09:42:22.233730+0000","last_clean":"2022-05-02T09:42:22.233730+0000","last_became_active":"2022-05-02T09:42:11.159326+0000","last_became_peered":"2022-05-02T09:42:11.159326+0000","last_unstale":"2022-05-02T09:42:22.233730+0000","last_undegraded":"2022-05-02T09:42:22.233730+0000","last_fullsized":"2022-05-02T09:42:22.233730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:42:17.406804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267420+0000","last_change":"2022-05-02T09:42:11.149256+0000","last_active":"2022-05-02T09:42:22.267420+0000","last_peered":"2022-05-02T09:42:22.267420+0000","last_clean":"2022-05-02T09:42:22.267420+0000","last_became_active":"2022-05-02T09:42:11.148401+0000","last_became_peered":"2022-05-02T09:42:11.148401+0000","last_unstale":"2022-05-02T09:42:22.267420+0000","last_undegraded":"2022-05-02T09:42:22.267420+0000","last_fullsized":"2022-05-02T09:42:22.267420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:20:13.943825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266447+0000","last_change":"2022-05-02T09:42:11.137531+0000","last_active":"2022-05-02T09:42:22.266447+0000","last_peered":"2022-05-02T09:42:22.266447+0000","last_clean":"2022-05-02T09:42:22.266447+0000","last_became_active":"2022-05-02T09:42:11.136740+0000","last_became_peered":"2022-05-02T09:42:11.136740+0000","last_unstale":"2022-05-02T09:42:22.266447+0000","last_undegraded":"2022-05-02T09:42:22.266447+0000","last_fullsized":"2022-05-02T09:42:22.266447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:12:53.196326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"35'19","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234761+0000","last_change":"2022-05-02T09:42:11.141461+0000","last_active":"2022-05-02T09:42:22.234761+0000","last_peered":"2022-05-02T09:42:22.234761+0000","last_clean":"2022-05-02T09:42:22.234761+0000","last_became_active":"2022-05-02T09:42:11.141012+0000","last_became_peered":"2022-05-02T09:42:11.141012+0000","last_unstale":"2022-05-02T09:42:22.234761+0000","last_undegraded":"2022-05-02T09:42:22.234761+0000","last_fullsized":"2022-05-02T09:42:22.234761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:35:53.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234201+0000","last_change":"2022-05-02T09:42:11.149968+0000","last_active":"2022-05-02T09:42:22.234201+0000","last_peered":"2022-05-02T09:42:22.234201+0000","last_clean":"2022-05-02T09:42:22.234201+0000","last_became_active":"2022-05-02T09:42:11.144166+0000","last_became_peered":"2022-05-02T09:42:11.144166+0000","last_unstale":"2022-05-02T09:42:22.234201+0000","last_undegraded":"2022-05-02T09:42:22.234201+0000","last_fullsized":"2022-05-02T09:42:22.234201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:06:54.193820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234090+0000","last_change":"2022-05-02T09:42:11.158283+0000","last_active":"2022-05-02T09:42:22.234090+0000","last_peered":"2022-05-02T09:42:22.234090+0000","last_clean":"2022-05-02T09:42:22.234090+0000","last_became_active":"2022-05-02T09:42:11.147007+0000","last_became_peered":"2022-05-02T09:42:11.147007+0000","last_unstale":"2022-05-02T09:42:22.234090+0000","last_undegraded":"2022-05-02T09:42:22.234090+0000","last_fullsized":"2022-05-02T09:42:22.234090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:48:46.677755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234812+0000","last_change":"2022-05-02T09:42:11.136965+0000","last_active":"2022-05-02T09:42:22.234812+0000","last_peered":"2022-05-02T09:42:22.234812+0000","last_clean":"2022-05-02T09:42:22.234812+0000","last_became_active":"2022-05-02T09:42:11.136611+0000","last_became_peered":"2022-05-02T09:42:11.136611+0000","last_unstale":"2022-05-02T09:42:22.234812+0000","last_undegraded":"2022-05-02T09:42:22.234812+0000","last_fullsized":"2022-05-02T09:42:22.234812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:00:46.212551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266407+0000","last_change":"2022-05-02T09:42:11.147333+0000","last_active":"2022-05-02T09:42:22.266407+0000","last_peered":"2022-05-02T09:42:22.266407+0000","last_clean":"2022-05-02T09:42:22.266407+0000","last_became_active":"2022-05-02T09:42:11.146921+0000","last_became_peered":"2022-05-02T09:42:11.146921+0000","last_unstale":"2022-05-02T09:42:22.266407+0000","last_undegraded":"2022-05-02T09:42:22.266407+0000","last_fullsized":"2022-05-02T09:42:22.266407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:55:15.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236149+0000","last_change":"2022-05-02T09:42:11.142219+0000","last_active":"2022-05-02T09:42:22.236149+0000","last_peered":"2022-05-02T09:42:22.236149+0000","last_clean":"2022-05-02T09:42:22.236149+0000","last_became_active":"2022-05-02T09:42:11.141628+0000","last_became_peered":"2022-05-02T09:42:11.141628+0000","last_unstale":"2022-05-02T09:42:22.236149+0000","last_undegraded":"2022-05-02T09:42:22.236149+0000","last_fullsized":"2022-05-02T09:42:22.236149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:19:13.784674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232727+0000","last_change":"2022-05-02T09:42:11.172785+0000","last_active":"2022-05-02T09:42:22.232727+0000","last_peered":"2022-05-02T09:42:22.232727+0000","last_clean":"2022-05-02T09:42:22.232727+0000","last_became_active":"2022-05-02T09:42:11.172114+0000","last_became_peered":"2022-05-02T09:42:11.172114+0000","last_unstale":"2022-05-02T09:42:22.232727+0000","last_undegraded":"2022-05-02T09:42:22.232727+0000","last_fullsized":"2022-05-02T09:42:22.232727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:58:01.906419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267235+0000","last_change":"2022-05-02T09:42:11.178041+0000","last_active":"2022-05-02T09:42:22.267235+0000","last_peered":"2022-05-02T09:42:22.267235+0000","last_clean":"2022-05-02T09:42:22.267235+0000","last_became_active":"2022-05-02T09:42:11.177747+0000","last_became_peered":"2022-05-02T09:42:11.177747+0000","last_unstale":"2022-05-02T09:42:22.267235+0000","last_undegraded":"2022-05-02T09:42:22.267235+0000","last_fullsized":"2022-05-02T09:42:22.267235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:49:38.923017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267555+0000","last_change":"2022-05-02T09:42:11.155858+0000","last_active":"2022-05-02T09:42:22.267555+0000","last_peered":"2022-05-02T09:42:22.267555+0000","last_clean":"2022-05-02T09:42:22.267555+0000","last_became_active":"2022-05-02T09:42:11.152700+0000","last_became_peered":"2022-05-02T09:42:11.152700+0000","last_unstale":"2022-05-02T09:42:22.267555+0000","last_undegraded":"2022-05-02T09:42:22.267555+0000","last_fullsized":"2022-05-02T09:42:22.267555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:51:01.329686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234305+0000","last_change":"2022-05-02T09:42:11.139177+0000","last_active":"2022-05-02T09:42:22.234305+0000","last_peered":"2022-05-02T09:42:22.234305+0000","last_clean":"2022-05-02T09:42:22.234305+0000","last_became_active":"2022-05-02T09:42:11.138148+0000","last_became_peered":"2022-05-02T09:42:11.138148+0000","last_unstale":"2022-05-02T09:42:22.234305+0000","last_undegraded":"2022-05-02T09:42:22.234305+0000","last_fullsized":"2022-05-02T09:42:22.234305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:45:20.078555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267775+0000","last_change":"2022-05-02T09:42:11.156276+0000","last_active":"2022-05-02T09:42:22.267775+0000","last_peered":"2022-05-02T09:42:22.267775+0000","last_clean":"2022-05-02T09:42:22.267775+0000","last_became_active":"2022-05-02T09:42:11.155655+0000","last_became_peered":"2022-05-02T09:42:11.155655+0000","last_unstale":"2022-05-02T09:42:22.267775+0000","last_undegraded":"2022-05-02T09:42:22.267775+0000","last_fullsized":"2022-05-02T09:42:22.267775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:32:28.346794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233065+0000","last_change":"2022-05-02T09:42:11.147252+0000","last_active":"2022-05-02T09:42:22.233065+0000","last_peered":"2022-05-02T09:42:22.233065+0000","last_clean":"2022-05-02T09:42:22.233065+0000","last_became_active":"2022-05-02T09:42:11.146464+0000","last_became_peered":"2022-05-02T09:42:11.146464+0000","last_unstale":"2022-05-02T09:42:22.233065+0000","last_undegraded":"2022-05-02T09:42:22.233065+0000","last_fullsized":"2022-05-02T09:42:22.233065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:45:33.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234500+0000","last_change":"2022-05-02T09:42:11.159110+0000","last_active":"2022-05-02T09:42:22.234500+0000","last_peered":"2022-05-02T09:42:22.234500+0000","last_clean":"2022-05-02T09:42:22.234500+0000","last_became_active":"2022-05-02T09:42:11.158793+0000","last_became_peered":"2022-05-02T09:42:11.158793+0000","last_unstale":"2022-05-02T09:42:22.234500+0000","last_undegraded":"2022-05-02T09:42:22.234500+0000","last_fullsized":"2022-05-02T09:42:22.234500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:34:35.779441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265983+0000","last_change":"2022-05-02T09:42:11.138209+0000","last_active":"2022-05-02T09:42:22.265983+0000","last_peered":"2022-05-02T09:42:22.265983+0000","last_clean":"2022-05-02T09:42:22.265983+0000","last_became_active":"2022-05-02T09:42:11.137685+0000","last_became_peered":"2022-05-02T09:42:11.137685+0000","last_unstale":"2022-05-02T09:42:22.265983+0000","last_undegraded":"2022-05-02T09:42:22.265983+0000","last_fullsized":"2022-05-02T09:42:22.265983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:15:13.380366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235578+0000","last_change":"2022-05-02T09:42:11.167527+0000","last_active":"2022-05-02T09:42:22.235578+0000","last_peered":"2022-05-02T09:42:22.235578+0000","last_clean":"2022-05-02T09:42:22.235578+0000","last_became_active":"2022-05-02T09:42:11.166183+0000","last_became_peered":"2022-05-02T09:42:11.166183+0000","last_unstale":"2022-05-02T09:42:22.235578+0000","last_undegraded":"2022-05-02T09:42:22.235578+0000","last_fullsized":"2022-05-02T09:42:22.235578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:07:21.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234958+0000","last_change":"2022-05-02T09:42:11.142739+0000","last_active":"2022-05-02T09:42:22.234958+0000","last_peered":"2022-05-02T09:42:22.234958+0000","last_clean":"2022-05-02T09:42:22.234958+0000","last_became_active":"2022-05-02T09:42:11.142021+0000","last_became_peered":"2022-05-02T09:42:11.142021+0000","last_unstale":"2022-05-02T09:42:22.234958+0000","last_undegraded":"2022-05-02T09:42:22.234958+0000","last_fullsized":"2022-05-02T09:42:22.234958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:17:06.039982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266916+0000","last_change":"2022-05-02T09:42:11.177948+0000","last_active":"2022-05-02T09:42:22.266916+0000","last_peered":"2022-05-02T09:42:22.266916+0000","last_clean":"2022-05-02T09:42:22.266916+0000","last_became_active":"2022-05-02T09:42:11.177629+0000","last_became_peered":"2022-05-02T09:42:11.177629+0000","last_unstale":"2022-05-02T09:42:22.266916+0000","last_undegraded":"2022-05-02T09:42:22.266916+0000","last_fullsized":"2022-05-02T09:42:22.266916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:03:22.945167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266957+0000","last_change":"2022-05-02T09:42:11.144154+0000","last_active":"2022-05-02T09:42:22.266957+0000","last_peered":"2022-05-02T09:42:22.266957+0000","last_clean":"2022-05-02T09:42:22.266957+0000","last_became_active":"2022-05-02T09:42:11.143871+0000","last_became_peered":"2022-05-02T09:42:11.143871+0000","last_unstale":"2022-05-02T09:42:22.266957+0000","last_undegraded":"2022-05-02T09:42:22.266957+0000","last_fullsized":"2022-05-02T09:42:22.266957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:18:37.067130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"35'5","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233947+0000","last_change":"2022-05-02T09:42:11.148418+0000","last_active":"2022-05-02T09:42:22.233947+0000","last_peered":"2022-05-02T09:42:22.233947+0000","last_clean":"2022-05-02T09:42:22.233947+0000","last_became_active":"2022-05-02T09:42:11.147491+0000","last_became_peered":"2022-05-02T09:42:11.147491+0000","last_unstale":"2022-05-02T09:42:22.233947+0000","last_undegraded":"2022-05-02T09:42:22.233947+0000","last_fullsized":"2022-05-02T09:42:22.233947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:09:41.112026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267020+0000","last_change":"2022-05-02T09:42:11.177932+0000","last_active":"2022-05-02T09:42:22.267020+0000","last_peered":"2022-05-02T09:42:22.267020+0000","last_clean":"2022-05-02T09:42:22.267020+0000","last_became_active":"2022-05-02T09:42:11.177612+0000","last_became_peered":"2022-05-02T09:42:11.177612+0000","last_unstale":"2022-05-02T09:42:22.267020+0000","last_undegraded":"2022-05-02T09:42:22.267020+0000","last_fullsized":"2022-05-02T09:42:22.267020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:21:49.840148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235028+0000","last_change":"2022-05-02T09:42:11.136832+0000","last_active":"2022-05-02T09:42:22.235028+0000","last_peered":"2022-05-02T09:42:22.235028+0000","last_clean":"2022-05-02T09:42:22.235028+0000","last_became_active":"2022-05-02T09:42:11.136081+0000","last_became_peered":"2022-05-02T09:42:11.136081+0000","last_unstale":"2022-05-02T09:42:22.235028+0000","last_undegraded":"2022-05-02T09:42:22.235028+0000","last_fullsized":"2022-05-02T09:42:22.235028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:22:04.741407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235934+0000","last_change":"2022-05-02T09:42:11.170348+0000","last_active":"2022-05-02T09:42:22.235934+0000","last_peered":"2022-05-02T09:42:22.235934+0000","last_clean":"2022-05-02T09:42:22.235934+0000","last_became_active":"2022-05-02T09:42:11.167266+0000","last_became_peered":"2022-05-02T09:42:11.167266+0000","last_unstale":"2022-05-02T09:42:22.235934+0000","last_undegraded":"2022-05-02T09:42:22.235934+0000","last_fullsized":"2022-05-02T09:42:22.235934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:15:30.411426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233969+0000","last_change":"2022-05-02T09:42:11.159622+0000","last_active":"2022-05-02T09:42:22.233969+0000","last_peered":"2022-05-02T09:42:22.233969+0000","last_clean":"2022-05-02T09:42:22.233969+0000","last_became_active":"2022-05-02T09:42:11.157809+0000","last_became_peered":"2022-05-02T09:42:11.157809+0000","last_unstale":"2022-05-02T09:42:22.233969+0000","last_undegraded":"2022-05-02T09:42:22.233969+0000","last_fullsized":"2022-05-02T09:42:22.233969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:03:53.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234690+0000","last_change":"2022-05-02T09:42:11.145091+0000","last_active":"2022-05-02T09:42:22.234690+0000","last_peered":"2022-05-02T09:42:22.234690+0000","last_clean":"2022-05-02T09:42:22.234690+0000","last_became_active":"2022-05-02T09:42:11.144797+0000","last_became_peered":"2022-05-02T09:42:11.144797+0000","last_unstale":"2022-05-02T09:42:22.234690+0000","last_undegraded":"2022-05-02T09:42:22.234690+0000","last_fullsized":"2022-05-02T09:42:22.234690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:11:12.974478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232848+0000","last_change":"2022-05-02T09:42:11.147120+0000","last_active":"2022-05-02T09:42:22.232848+0000","last_peered":"2022-05-02T09:42:22.232848+0000","last_clean":"2022-05-02T09:42:22.232848+0000","last_became_active":"2022-05-02T09:42:11.146227+0000","last_became_peered":"2022-05-02T09:42:11.146227+0000","last_unstale":"2022-05-02T09:42:22.232848+0000","last_undegraded":"2022-05-02T09:42:22.232848+0000","last_fullsized":"2022-05-02T09:42:22.232848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:39:10.090806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267503+0000","last_change":"2022-05-02T09:42:11.168844+0000","last_active":"2022-05-02T09:42:22.267503+0000","last_peered":"2022-05-02T09:42:22.267503+0000","last_clean":"2022-05-02T09:42:22.267503+0000","last_became_active":"2022-05-02T09:42:11.167851+0000","last_became_peered":"2022-05-02T09:42:11.167851+0000","last_unstale":"2022-05-02T09:42:22.267503+0000","last_undegraded":"2022-05-02T09:42:22.267503+0000","last_fullsized":"2022-05-02T09:42:22.267503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:11:58.151521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266414+0000","last_change":"2022-05-02T09:42:11.145632+0000","last_active":"2022-05-02T09:42:22.266414+0000","last_peered":"2022-05-02T09:42:22.266414+0000","last_clean":"2022-05-02T09:42:22.266414+0000","last_became_active":"2022-05-02T09:42:11.145308+0000","last_became_peered":"2022-05-02T09:42:11.145308+0000","last_unstale":"2022-05-02T09:42:22.266414+0000","last_undegraded":"2022-05-02T09:42:22.266414+0000","last_fullsized":"2022-05-02T09:42:22.266414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:13:06.777121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234366+0000","last_change":"2022-05-02T09:42:11.155332+0000","last_active":"2022-05-02T09:42:22.234366+0000","last_peered":"2022-05-02T09:42:22.234366+0000","last_clean":"2022-05-02T09:42:22.234366+0000","last_became_active":"2022-05-02T09:42:11.154780+0000","last_became_peered":"2022-05-02T09:42:11.154780+0000","last_unstale":"2022-05-02T09:42:22.234366+0000","last_undegraded":"2022-05-02T09:42:22.234366+0000","last_fullsized":"2022-05-02T09:42:22.234366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:30:21.891270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266255+0000","last_change":"2022-05-02T09:42:11.137735+0000","last_active":"2022-05-02T09:42:22.266255+0000","last_peered":"2022-05-02T09:42:22.266255+0000","last_clean":"2022-05-02T09:42:22.266255+0000","last_became_active":"2022-05-02T09:42:11.137094+0000","last_became_peered":"2022-05-02T09:42:11.137094+0000","last_unstale":"2022-05-02T09:42:22.266255+0000","last_undegraded":"2022-05-02T09:42:22.266255+0000","last_fullsized":"2022-05-02T09:42:22.266255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:31:24.720103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235075+0000","last_change":"2022-05-02T09:42:11.137011+0000","last_active":"2022-05-02T09:42:22.235075+0000","last_peered":"2022-05-02T09:42:22.235075+0000","last_clean":"2022-05-02T09:42:22.235075+0000","last_became_active":"2022-05-02T09:42:11.136475+0000","last_became_peered":"2022-05-02T09:42:11.136475+0000","last_unstale":"2022-05-02T09:42:22.235075+0000","last_undegraded":"2022-05-02T09:42:22.235075+0000","last_fullsized":"2022-05-02T09:42:22.235075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:36:58.998012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266855+0000","last_change":"2022-05-02T09:42:11.163195+0000","last_active":"2022-05-02T09:42:22.266855+0000","last_peered":"2022-05-02T09:42:22.266855+0000","last_clean":"2022-05-02T09:42:22.266855+0000","last_became_active":"2022-05-02T09:42:11.162886+0000","last_became_peered":"2022-05-02T09:42:11.162886+0000","last_unstale":"2022-05-02T09:42:22.266855+0000","last_undegraded":"2022-05-02T09:42:22.266855+0000","last_fullsized":"2022-05-02T09:42:22.266855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:38:45.041691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266327+0000","last_change":"2022-05-02T09:42:11.165766+0000","last_active":"2022-05-02T09:42:22.266327+0000","last_peered":"2022-05-02T09:42:22.266327+0000","last_clean":"2022-05-02T09:42:22.266327+0000","last_became_active":"2022-05-02T09:42:11.160253+0000","last_became_peered":"2022-05-02T09:42:11.160253+0000","last_unstale":"2022-05-02T09:42:22.266327+0000","last_undegraded":"2022-05-02T09:42:22.266327+0000","last_fullsized":"2022-05-02T09:42:22.266327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:44:20.655344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234098+0000","last_change":"2022-05-02T09:42:11.159656+0000","last_active":"2022-05-02T09:42:22.234098+0000","last_peered":"2022-05-02T09:42:22.234098+0000","last_clean":"2022-05-02T09:42:22.234098+0000","last_became_active":"2022-05-02T09:42:11.143620+0000","last_became_peered":"2022-05-02T09:42:11.143620+0000","last_unstale":"2022-05-02T09:42:22.234098+0000","last_undegraded":"2022-05-02T09:42:22.234098+0000","last_fullsized":"2022-05-02T09:42:22.234098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:04:45.752771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267770+0000","last_change":"2022-05-02T09:42:11.162434+0000","last_active":"2022-05-02T09:42:22.267770+0000","last_peered":"2022-05-02T09:42:22.267770+0000","last_clean":"2022-05-02T09:42:22.267770+0000","last_became_active":"2022-05-02T09:42:11.161796+0000","last_became_peered":"2022-05-02T09:42:11.161796+0000","last_unstale":"2022-05-02T09:42:22.267770+0000","last_undegraded":"2022-05-02T09:42:22.267770+0000","last_fullsized":"2022-05-02T09:42:22.267770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:26:35.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267267+0000","last_change":"2022-05-02T09:42:11.152765+0000","last_active":"2022-05-02T09:42:22.267267+0000","last_peered":"2022-05-02T09:42:22.267267+0000","last_clean":"2022-05-02T09:42:22.267267+0000","last_became_active":"2022-05-02T09:42:11.152430+0000","last_became_peered":"2022-05-02T09:42:11.152430+0000","last_unstale":"2022-05-02T09:42:22.267267+0000","last_undegraded":"2022-05-02T09:42:22.267267+0000","last_fullsized":"2022-05-02T09:42:22.267267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:43:40.480738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233797+0000","last_change":"2022-05-02T09:42:11.142176+0000","last_active":"2022-05-02T09:42:22.233797+0000","last_peered":"2022-05-02T09:42:22.233797+0000","last_clean":"2022-05-02T09:42:22.233797+0000","last_became_active":"2022-05-02T09:42:11.141830+0000","last_became_peered":"2022-05-02T09:42:11.141830+0000","last_unstale":"2022-05-02T09:42:22.233797+0000","last_undegraded":"2022-05-02T09:42:22.233797+0000","last_fullsized":"2022-05-02T09:42:22.233797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:39:27.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265600+0000","last_change":"2022-05-02T09:42:11.156053+0000","last_active":"2022-05-02T09:42:22.265600+0000","last_peered":"2022-05-02T09:42:22.265600+0000","last_clean":"2022-05-02T09:42:22.265600+0000","last_became_active":"2022-05-02T09:42:11.153177+0000","last_became_peered":"2022-05-02T09:42:11.153177+0000","last_unstale":"2022-05-02T09:42:22.265600+0000","last_undegraded":"2022-05-02T09:42:22.265600+0000","last_fullsized":"2022-05-02T09:42:22.265600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","objects_scrubbed":0,"log_size":115,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:08:25.619990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":104,"num_write":157,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235317+0000","last_change":"2022-05-02T09:42:11.149487+0000","last_active":"2022-05-02T09:42:22.235317+0000","last_peered":"2022-05-02T09:42:22.235317+0000","last_clean":"2022-05-02T09:42:22.235317+0000","last_became_active":"2022-05-02T09:42:11.147756+0000","last_became_peered":"2022-05-02T09:42:11.147756+0000","last_unstale":"2022-05-02T09:42:22.235317+0000","last_undegraded":"2022-05-02T09:42:22.235317+0000","last_fullsized":"2022-05-02T09:42:22.235317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:35:42.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235864+0000","last_change":"2022-05-02T09:42:11.167964+0000","last_active":"2022-05-02T09:42:22.235864+0000","last_peered":"2022-05-02T09:42:22.235864+0000","last_clean":"2022-05-02T09:42:22.235864+0000","last_became_active":"2022-05-02T09:42:11.166560+0000","last_became_peered":"2022-05-02T09:42:11.166560+0000","last_unstale":"2022-05-02T09:42:22.235864+0000","last_undegraded":"2022-05-02T09:42:22.235864+0000","last_fullsized":"2022-05-02T09:42:22.235864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:40:49.146399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232701+0000","last_change":"2022-05-02T09:42:11.146877+0000","last_active":"2022-05-02T09:42:22.232701+0000","last_peered":"2022-05-02T09:42:22.232701+0000","last_clean":"2022-05-02T09:42:22.232701+0000","last_became_active":"2022-05-02T09:42:11.146096+0000","last_became_peered":"2022-05-02T09:42:11.146096+0000","last_unstale":"2022-05-02T09:42:22.232701+0000","last_undegraded":"2022-05-02T09:42:22.232701+0000","last_fullsized":"2022-05-02T09:42:22.232701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T09:44:56.367461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266281+0000","last_change":"2022-05-02T09:42:11.169866+0000","last_active":"2022-05-02T09:42:22.266281+0000","last_peered":"2022-05-02T09:42:22.266281+0000","last_clean":"2022-05-02T09:42:22.266281+0000","last_became_active":"2022-05-02T09:42:11.169462+0000","last_became_peered":"2022-05-02T09:42:11.169462+0000","last_unstale":"2022-05-02T09:42:22.266281+0000","last_undegraded":"2022-05-02T09:42:22.266281+0000","last_fullsized":"2022-05-02T09:42:22.266281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:44:45.353405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267013+0000","last_change":"2022-05-02T09:42:11.150708+0000","last_active":"2022-05-02T09:42:22.267013+0000","last_peered":"2022-05-02T09:42:22.267013+0000","last_clean":"2022-05-02T09:42:22.267013+0000","last_became_active":"2022-05-02T09:42:11.149930+0000","last_became_peered":"2022-05-02T09:42:11.149930+0000","last_unstale":"2022-05-02T09:42:22.267013+0000","last_undegraded":"2022-05-02T09:42:22.267013+0000","last_fullsized":"2022-05-02T09:42:22.267013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:08:41.146130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235946+0000","last_change":"2022-05-02T09:42:11.142181+0000","last_active":"2022-05-02T09:42:22.235946+0000","last_peered":"2022-05-02T09:42:22.235946+0000","last_clean":"2022-05-02T09:42:22.235946+0000","last_became_active":"2022-05-02T09:42:11.141353+0000","last_became_peered":"2022-05-02T09:42:11.141353+0000","last_unstale":"2022-05-02T09:42:22.235946+0000","last_undegraded":"2022-05-02T09:42:22.235946+0000","last_fullsized":"2022-05-02T09:42:22.235946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:44:31.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266719+0000","last_change":"2022-05-02T09:42:11.166036+0000","last_active":"2022-05-02T09:42:22.266719+0000","last_peered":"2022-05-02T09:42:22.266719+0000","last_clean":"2022-05-02T09:42:22.266719+0000","last_became_active":"2022-05-02T09:42:11.161036+0000","last_became_peered":"2022-05-02T09:42:11.161036+0000","last_unstale":"2022-05-02T09:42:22.266719+0000","last_undegraded":"2022-05-02T09:42:22.266719+0000","last_fullsized":"2022-05-02T09:42:22.266719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:07:18.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267057+0000","last_change":"2022-05-02T09:42:11.169655+0000","last_active":"2022-05-02T09:42:22.267057+0000","last_peered":"2022-05-02T09:42:22.267057+0000","last_clean":"2022-05-02T09:42:22.267057+0000","last_became_active":"2022-05-02T09:42:11.169322+0000","last_became_peered":"2022-05-02T09:42:11.169322+0000","last_unstale":"2022-05-02T09:42:22.267057+0000","last_undegraded":"2022-05-02T09:42:22.267057+0000","last_fullsized":"2022-05-02T09:42:22.267057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:00:20.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234520+0000","last_change":"2022-05-02T09:42:11.139403+0000","last_active":"2022-05-02T09:42:22.234520+0000","last_peered":"2022-05-02T09:42:22.234520+0000","last_clean":"2022-05-02T09:42:22.234520+0000","last_became_active":"2022-05-02T09:42:11.138435+0000","last_became_peered":"2022-05-02T09:42:11.138435+0000","last_unstale":"2022-05-02T09:42:22.234520+0000","last_undegraded":"2022-05-02T09:42:22.234520+0000","last_fullsized":"2022-05-02T09:42:22.234520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:58:07.024496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266575+0000","last_change":"2022-05-02T09:42:11.153855+0000","last_active":"2022-05-02T09:42:22.266575+0000","last_peered":"2022-05-02T09:42:22.266575+0000","last_clean":"2022-05-02T09:42:22.266575+0000","last_became_active":"2022-05-02T09:42:11.153075+0000","last_became_peered":"2022-05-02T09:42:11.153075+0000","last_unstale":"2022-05-02T09:42:22.266575+0000","last_undegraded":"2022-05-02T09:42:22.266575+0000","last_fullsized":"2022-05-02T09:42:22.266575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:13:35.778812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233164+0000","last_change":"2022-05-02T09:42:11.147337+0000","last_active":"2022-05-02T09:42:22.233164+0000","last_peered":"2022-05-02T09:42:22.233164+0000","last_clean":"2022-05-02T09:42:22.233164+0000","last_became_active":"2022-05-02T09:42:11.146481+0000","last_became_peered":"2022-05-02T09:42:11.146481+0000","last_unstale":"2022-05-02T09:42:22.233164+0000","last_undegraded":"2022-05-02T09:42:22.233164+0000","last_fullsized":"2022-05-02T09:42:22.233164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:07:05.053449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234247+0000","last_change":"2022-05-02T09:42:11.160454+0000","last_active":"2022-05-02T09:42:22.234247+0000","last_peered":"2022-05-02T09:42:22.234247+0000","last_clean":"2022-05-02T09:42:22.234247+0000","last_became_active":"2022-05-02T09:42:11.159571+0000","last_became_peered":"2022-05-02T09:42:11.159571+0000","last_unstale":"2022-05-02T09:42:22.234247+0000","last_undegraded":"2022-05-02T09:42:22.234247+0000","last_fullsized":"2022-05-02T09:42:22.234247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:32:22.833040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267178+0000","last_change":"2022-05-02T09:42:11.151002+0000","last_active":"2022-05-02T09:42:22.267178+0000","last_peered":"2022-05-02T09:42:22.267178+0000","last_clean":"2022-05-02T09:42:22.267178+0000","last_became_active":"2022-05-02T09:42:11.150642+0000","last_became_peered":"2022-05-02T09:42:11.150642+0000","last_unstale":"2022-05-02T09:42:22.267178+0000","last_undegraded":"2022-05-02T09:42:22.267178+0000","last_fullsized":"2022-05-02T09:42:22.267178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:29:15.390097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233996+0000","last_change":"2022-05-02T09:42:11.162019+0000","last_active":"2022-05-02T09:42:22.233996+0000","last_peered":"2022-05-02T09:42:22.233996+0000","last_clean":"2022-05-02T09:42:22.233996+0000","last_became_active":"2022-05-02T09:42:11.144060+0000","last_became_peered":"2022-05-02T09:42:11.144060+0000","last_unstale":"2022-05-02T09:42:22.233996+0000","last_undegraded":"2022-05-02T09:42:22.233996+0000","last_fullsized":"2022-05-02T09:42:22.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:07:39.945818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'11","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267188+0000","last_change":"2022-05-02T09:42:11.178305+0000","last_active":"2022-05-02T09:42:22.267188+0000","last_peered":"2022-05-02T09:42:22.267188+0000","last_clean":"2022-05-02T09:42:22.267188+0000","last_became_active":"2022-05-02T09:42:11.177959+0000","last_became_peered":"2022-05-02T09:42:11.177959+0000","last_unstale":"2022-05-02T09:42:22.267188+0000","last_undegraded":"2022-05-02T09:42:22.267188+0000","last_fullsized":"2022-05-02T09:42:22.267188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:28:40.825170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236139+0000","last_change":"2022-05-02T09:42:11.149580+0000","last_active":"2022-05-02T09:42:22.236139+0000","last_peered":"2022-05-02T09:42:22.236139+0000","last_clean":"2022-05-02T09:42:22.236139+0000","last_became_active":"2022-05-02T09:42:11.149285+0000","last_became_peered":"2022-05-02T09:42:11.149285+0000","last_unstale":"2022-05-02T09:42:22.236139+0000","last_undegraded":"2022-05-02T09:42:22.236139+0000","last_fullsized":"2022-05-02T09:42:22.236139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:50:09.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266153+0000","last_change":"2022-05-02T09:42:11.140860+0000","last_active":"2022-05-02T09:42:22.266153+0000","last_peered":"2022-05-02T09:42:22.266153+0000","last_clean":"2022-05-02T09:42:22.266153+0000","last_became_active":"2022-05-02T09:42:11.140505+0000","last_became_peered":"2022-05-02T09:42:11.140505+0000","last_unstale":"2022-05-02T09:42:22.266153+0000","last_undegraded":"2022-05-02T09:42:22.266153+0000","last_fullsized":"2022-05-02T09:42:22.266153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:02:58.994281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234396+0000","last_change":"2022-05-02T09:42:11.147934+0000","last_active":"2022-05-02T09:42:22.234396+0000","last_peered":"2022-05-02T09:42:22.234396+0000","last_clean":"2022-05-02T09:42:22.234396+0000","last_became_active":"2022-05-02T09:42:11.143773+0000","last_became_peered":"2022-05-02T09:42:11.143773+0000","last_unstale":"2022-05-02T09:42:22.234396+0000","last_undegraded":"2022-05-02T09:42:22.234396+0000","last_fullsized":"2022-05-02T09:42:22.234396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:14:48.313503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235833+0000","last_change":"2022-05-02T09:42:11.142000+0000","last_active":"2022-05-02T09:42:22.235833+0000","last_peered":"2022-05-02T09:42:22.235833+0000","last_clean":"2022-05-02T09:42:22.235833+0000","last_became_active":"2022-05-02T09:42:11.135477+0000","last_became_peered":"2022-05-02T09:42:11.135477+0000","last_unstale":"2022-05-02T09:42:22.235833+0000","last_undegraded":"2022-05-02T09:42:22.235833+0000","last_fullsized":"2022-05-02T09:42:22.235833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:41:02.358136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234910+0000","last_change":"2022-05-02T09:42:11.142928+0000","last_active":"2022-05-02T09:42:22.234910+0000","last_peered":"2022-05-02T09:42:22.234910+0000","last_clean":"2022-05-02T09:42:22.234910+0000","last_became_active":"2022-05-02T09:42:11.142377+0000","last_became_peered":"2022-05-02T09:42:11.142377+0000","last_unstale":"2022-05-02T09:42:22.234910+0000","last_undegraded":"2022-05-02T09:42:22.234910+0000","last_fullsized":"2022-05-02T09:42:22.234910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:51:38.254463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234096+0000","last_change":"2022-05-02T09:42:11.165075+0000","last_active":"2022-05-02T09:42:22.234096+0000","last_peered":"2022-05-02T09:42:22.234096+0000","last_clean":"2022-05-02T09:42:22.234096+0000","last_became_active":"2022-05-02T09:42:11.164470+0000","last_became_peered":"2022-05-02T09:42:11.164470+0000","last_unstale":"2022-05-02T09:42:22.234096+0000","last_undegraded":"2022-05-02T09:42:22.234096+0000","last_fullsized":"2022-05-02T09:42:22.234096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:27:43.236423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233096+0000","last_change":"2022-05-02T09:42:11.172701+0000","last_active":"2022-05-02T09:42:22.233096+0000","last_peered":"2022-05-02T09:42:22.233096+0000","last_clean":"2022-05-02T09:42:22.233096+0000","last_became_active":"2022-05-02T09:42:11.171758+0000","last_became_peered":"2022-05-02T09:42:11.171758+0000","last_unstale":"2022-05-02T09:42:22.233096+0000","last_undegraded":"2022-05-02T09:42:22.233096+0000","last_fullsized":"2022-05-02T09:42:22.233096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:28:51.143802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"35'5","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267767+0000","last_change":"2022-05-02T09:42:11.157311+0000","last_active":"2022-05-02T09:42:22.267767+0000","last_peered":"2022-05-02T09:42:22.267767+0000","last_clean":"2022-05-02T09:42:22.267767+0000","last_became_active":"2022-05-02T09:42:11.157005+0000","last_became_peered":"2022-05-02T09:42:11.157005+0000","last_unstale":"2022-05-02T09:42:22.267767+0000","last_undegraded":"2022-05-02T09:42:22.267767+0000","last_fullsized":"2022-05-02T09:42:22.267767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:14:49.793124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233488+0000","last_change":"2022-05-02T09:42:11.148867+0000","last_active":"2022-05-02T09:42:22.233488+0000","last_peered":"2022-05-02T09:42:22.233488+0000","last_clean":"2022-05-02T09:42:22.233488+0000","last_became_active":"2022-05-02T09:42:11.148467+0000","last_became_peered":"2022-05-02T09:42:11.148467+0000","last_unstale":"2022-05-02T09:42:22.233488+0000","last_undegraded":"2022-05-02T09:42:22.233488+0000","last_fullsized":"2022-05-02T09:42:22.233488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:53:49.986739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267645+0000","last_change":"2022-05-02T09:42:11.164352+0000","last_active":"2022-05-02T09:42:22.267645+0000","last_peered":"2022-05-02T09:42:22.267645+0000","last_clean":"2022-05-02T09:42:22.267645+0000","last_became_active":"2022-05-02T09:42:11.161475+0000","last_became_peered":"2022-05-02T09:42:11.161475+0000","last_unstale":"2022-05-02T09:42:22.267645+0000","last_undegraded":"2022-05-02T09:42:22.267645+0000","last_fullsized":"2022-05-02T09:42:22.267645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:16:17.690303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233532+0000","last_change":"2022-05-02T09:42:11.143012+0000","last_active":"2022-05-02T09:42:22.233532+0000","last_peered":"2022-05-02T09:42:22.233532+0000","last_clean":"2022-05-02T09:42:22.233532+0000","last_became_active":"2022-05-02T09:42:11.142720+0000","last_became_peered":"2022-05-02T09:42:11.142720+0000","last_unstale":"2022-05-02T09:42:22.233532+0000","last_undegraded":"2022-05-02T09:42:22.233532+0000","last_fullsized":"2022-05-02T09:42:22.233532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:39:43.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266503+0000","last_change":"2022-05-02T09:42:11.147262+0000","last_active":"2022-05-02T09:42:22.266503+0000","last_peered":"2022-05-02T09:42:22.266503+0000","last_clean":"2022-05-02T09:42:22.266503+0000","last_became_active":"2022-05-02T09:42:11.146523+0000","last_became_peered":"2022-05-02T09:42:11.146523+0000","last_unstale":"2022-05-02T09:42:22.266503+0000","last_undegraded":"2022-05-02T09:42:22.266503+0000","last_fullsized":"2022-05-02T09:42:22.266503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:34:34.437245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234499+0000","last_change":"2022-05-02T09:42:11.158825+0000","last_active":"2022-05-02T09:42:22.234499+0000","last_peered":"2022-05-02T09:42:22.234499+0000","last_clean":"2022-05-02T09:42:22.234499+0000","last_became_active":"2022-05-02T09:42:11.158405+0000","last_became_peered":"2022-05-02T09:42:11.158405+0000","last_unstale":"2022-05-02T09:42:22.234499+0000","last_undegraded":"2022-05-02T09:42:22.234499+0000","last_fullsized":"2022-05-02T09:42:22.234499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:58:11.481883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266581+0000","last_change":"2022-05-02T09:42:11.165773+0000","last_active":"2022-05-02T09:42:22.266581+0000","last_peered":"2022-05-02T09:42:22.266581+0000","last_clean":"2022-05-02T09:42:22.266581+0000","last_became_active":"2022-05-02T09:42:11.160657+0000","last_became_peered":"2022-05-02T09:42:11.160657+0000","last_unstale":"2022-05-02T09:42:22.266581+0000","last_undegraded":"2022-05-02T09:42:22.266581+0000","last_fullsized":"2022-05-02T09:42:22.266581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:53:11.907264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8781,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":19,"num_read_kb":21,"num_write":116,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43617,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":104,"num_write":157,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3976,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":31,"seq":133143986181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":352,"kb_used_omap":9,"kb_used_meta":7670,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":360448,"data_stored":153691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9631,"internal_metadata":7854689},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":1,"up_from":31,"seq":133143986181,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12896,"kb_used_data":920,"kb_used_omap":6,"kb_used_meta":11961,"kb_avail":94358944,"statfs":{"total":96636764160,"available":96623558656,"internally_reserved":0,"allocated":942080,"data_stored":739579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6299,"internal_metadata":12248933},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":31,"seq":133143986181,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12484,"kb_used_data":380,"kb_used_omap":12,"kb_used_meta":12083,"kb_avail":94359356,"statfs":{"total":96636764160,"available":96623980544,"internally_reserved":0,"allocated":389120,"data_stored":156772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12420,"internal_metadata":12373884},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":29,"seq":124554051589,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13044,"kb_used_data":940,"kb_used_omap":18,"kb_used_meta":12077,"kb_avail":94358796,"statfs":{"total":96636764160,"available":96623407104,"internally_reserved":0,"allocated":962560,"data_stored":742520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19244,"internal_metadata":12367060},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3976,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15267,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6299,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9631,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12420,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-02T09:42:27.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-05-02T09:42:27.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.719+0000 7f045339d700 1 Processor -- start 2022-05-02T09:42:27.721 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.719+0000 7f045339d700 1 -- start start 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f044c0636c0 0x7f044c0a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 0x7f044c13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c063a90 con 0x7f044c0636c0 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0a8f60 con 0x7f044c13e250 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045339d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044c13da70 con 0x7f044c0a9740 2022-05-02T09:42:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f0451b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 0x7f044c13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045239b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f044c0636c0 0x7f044c0a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f0452b9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f0451b9a700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 0x7f044c13dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50140/0 (socket says 172.21.15.50:50140) 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f0451b9a700 1 -- 172.21.15.50:0/49882157 learned_addr learned my addr 172.21.15.50:0/49882157 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f0452b9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50826/0 (socket says 172.21.15.50:50826) 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.720+0000 7f045239b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f044c0636c0 0x7f044c0a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36276/0 (socket says 172.21.15.50:36276) 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 -- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 msgr2=0x7f044c13dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 0x7f044c13dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 -- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 msgr2=0x7f044c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:27.726 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 -- 172.21.15.50:0/49882157 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0a3ff0 con 0x7f044c0636c0 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f0452b9c700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.721+0000 7f045239b700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0636c0 0x7f044c0a7b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0448009760 tx=0x7f0448009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01e09cca7b632a3 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f0451399700 1 -- 172.21.15.50:0/49882157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480105b0 con 0x7f044c0636c0 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f0451399700 1 -- 172.21.15.50:0/49882157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448010710 con 0x7f044c0636c0 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f0451399700 1 -- 172.21.15.50:0/49882157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448010ab0 con 0x7f044c0636c0 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 -- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0636c0 msgr2=0x7f044c0a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0636c0 0x7f044c0a7b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0448009760 tx=0x7f0448009060 comp rx=0 tx=0).stop 2022-05-02T09:42:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 -- 172.21.15.50:0/49882157 shutdown_connections 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0636c0 0x7f044c0a7b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 --2- 172.21.15.50:0/49882157 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0a9740 0x7f044c13dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 -- 172.21.15.50:0/49882157 >> 172.21.15.50:0/49882157 conn(0x7f044c067c60 msgr2=0x7f044c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.722+0000 7f045339d700 1 -- 172.21.15.50:0/49882157 shutdown_connections 2022-05-02T09:42:27.728 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.723+0000 7f045339d700 1 -- 172.21.15.50:0/49882157 wait complete. 2022-05-02T09:42:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.724+0000 7f045339d700 1 Processor -- start 2022-05-02T09:42:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.724+0000 7f045339d700 1 -- start start 2022-05-02T09:42:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0a9740 0x7f044c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c14b5a0 con 0x7f044c0a9740 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c141540 con 0x7f044c13e250 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045339d700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1417e0 con 0x7f044c0636c0 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045239b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f0451b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0a9740 0x7f044c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045239b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50142/0 (socket says 172.21.15.50:50142) 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f045239b700 1 -- 172.21.15.50:0/3818518628 learned_addr learned my addr 172.21.15.50:0/3818518628 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.725+0000 7f0452b9c700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 -- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 msgr2=0x7f044c0ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c0ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 -- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0a9740 msgr2=0x7f044c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0a9740 0x7f044c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 -- 172.21.15.50:0/3818518628 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009a20 con 0x7f044c0636c0 2022-05-02T09:42:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045239b700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0448009d50 tx=0x7f0448016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448010a90 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448000c90 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f045339d700 1 -- 172.21.15.50:0/3818518628 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04480092a0 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.726+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448004280 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.727+0000 7f045339d700 1 -- 172.21.15.50:0/3818518628 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c0af600 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.728+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0424005130 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.728+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f044800f070 con 0x7f044c0636c0 2022-05-02T09:42:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.729+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f044805b390 con 0x7f044c0636c0 2022-05-02T09:42:27.735 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.733+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f0448026020 con 0x7f044c0636c0 2022-05-02T09:42:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.885+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 --> v1:172.21.15.50:6800/36423 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0424000bc0 con 0x7f042c044b40 2022-05-02T09:42:27.895 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.893+0000 7f043a7fc700 1 -- 172.21.15.50:0/3818518628 <== mgr.14098 v1:172.21.15.50:6800/36423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269531 (unknown 2965378022 0 1880942100) 0x7f0424000bc0 con 0x7f042c044b40 2022-05-02T09:42:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 >> v1:172.21.15.50:6800/36423 conn(0x7f042c044b40 legacy=0x7f042c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 msgr2=0x7f044c0b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0448009d50 tx=0x7f0448016000 comp rx=0 tx=0).stop 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 shutdown_connections 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f044c0636c0 0x7f044c0b0580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f044c13e250 0x7f044c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 --2- 172.21.15.50:0/3818518628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f044c0a9740 0x7f044c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 >> 172.21.15.50:0/3818518628 conn(0x7f044c067c60 msgr2=0x7f044c13cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 shutdown_connections 2022-05-02T09:42:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:27.897+0000 7f042bfff700 1 -- 172.21.15.50:0/3818518628 wait complete. 2022-05-02T09:42:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2022-05-02T09:42:27.924 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2022-05-02T09:42:27.584293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599149,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":136,"num_read_kb":125,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":46464,"kb_used_data":2592,"kb_used_omap":46,"kb_used_meta":43793,"kb_avail":377440896,"statfs":{"total":386547056640,"available":386499477504,"internally_reserved":0,"allocated":2654208,"data_stored":1792562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47594,"internal_metadata":44844566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.359765"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234819+0000","last_change":"2022-05-02T09:42:11.156252+0000","last_active":"2022-05-02T09:42:22.234819+0000","last_peered":"2022-05-02T09:42:22.234819+0000","last_clean":"2022-05-02T09:42:22.234819+0000","last_became_active":"2022-05-02T09:42:11.151643+0000","last_became_peered":"2022-05-02T09:42:11.151643+0000","last_unstale":"2022-05-02T09:42:22.234819+0000","last_undegraded":"2022-05-02T09:42:22.234819+0000","last_fullsized":"2022-05-02T09:42:22.234819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:21:13.551818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234309+0000","last_change":"2022-05-02T09:42:11.145724+0000","last_active":"2022-05-02T09:42:22.234309+0000","last_peered":"2022-05-02T09:42:22.234309+0000","last_clean":"2022-05-02T09:42:22.234309+0000","last_became_active":"2022-05-02T09:42:11.145372+0000","last_became_peered":"2022-05-02T09:42:11.145372+0000","last_unstale":"2022-05-02T09:42:22.234309+0000","last_undegraded":"2022-05-02T09:42:22.234309+0000","last_fullsized":"2022-05-02T09:42:22.234309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:04:30.356588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267305+0000","last_change":"2022-05-02T09:42:11.154782+0000","last_active":"2022-05-02T09:42:22.267305+0000","last_peered":"2022-05-02T09:42:22.267305+0000","last_clean":"2022-05-02T09:42:22.267305+0000","last_became_active":"2022-05-02T09:42:11.154267+0000","last_became_peered":"2022-05-02T09:42:11.154267+0000","last_unstale":"2022-05-02T09:42:22.267305+0000","last_undegraded":"2022-05-02T09:42:22.267305+0000","last_fullsized":"2022-05-02T09:42:22.267305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:19:56.995375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267062+0000","last_change":"2022-05-02T09:42:11.150154+0000","last_active":"2022-05-02T09:42:22.267062+0000","last_peered":"2022-05-02T09:42:22.267062+0000","last_clean":"2022-05-02T09:42:22.267062+0000","last_became_active":"2022-05-02T09:42:11.149798+0000","last_became_peered":"2022-05-02T09:42:11.149798+0000","last_unstale":"2022-05-02T09:42:22.267062+0000","last_undegraded":"2022-05-02T09:42:22.267062+0000","last_fullsized":"2022-05-02T09:42:22.267062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:55:31.986532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266733+0000","last_change":"2022-05-02T09:42:11.180791+0000","last_active":"2022-05-02T09:42:22.266733+0000","last_peered":"2022-05-02T09:42:22.266733+0000","last_clean":"2022-05-02T09:42:22.266733+0000","last_became_active":"2022-05-02T09:42:11.180378+0000","last_became_peered":"2022-05-02T09:42:11.180378+0000","last_unstale":"2022-05-02T09:42:22.266733+0000","last_undegraded":"2022-05-02T09:42:22.266733+0000","last_fullsized":"2022-05-02T09:42:22.266733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:23:18.941143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235200+0000","last_change":"2022-05-02T09:42:11.149822+0000","last_active":"2022-05-02T09:42:22.235200+0000","last_peered":"2022-05-02T09:42:22.235200+0000","last_clean":"2022-05-02T09:42:22.235200+0000","last_became_active":"2022-05-02T09:42:11.145645+0000","last_became_peered":"2022-05-02T09:42:11.145645+0000","last_unstale":"2022-05-02T09:42:22.235200+0000","last_undegraded":"2022-05-02T09:42:22.235200+0000","last_fullsized":"2022-05-02T09:42:22.235200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:34:25.925032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233828+0000","last_change":"2022-05-02T09:42:11.163438+0000","last_active":"2022-05-02T09:42:22.233828+0000","last_peered":"2022-05-02T09:42:22.233828+0000","last_clean":"2022-05-02T09:42:22.233828+0000","last_became_active":"2022-05-02T09:42:11.159963+0000","last_became_peered":"2022-05-02T09:42:11.159963+0000","last_unstale":"2022-05-02T09:42:22.233828+0000","last_undegraded":"2022-05-02T09:42:22.233828+0000","last_fullsized":"2022-05-02T09:42:22.233828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:08:09.761710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265746+0000","last_change":"2022-05-02T09:42:11.153815+0000","last_active":"2022-05-02T09:42:22.265746+0000","last_peered":"2022-05-02T09:42:22.265746+0000","last_clean":"2022-05-02T09:42:22.265746+0000","last_became_active":"2022-05-02T09:42:11.152263+0000","last_became_peered":"2022-05-02T09:42:11.152263+0000","last_unstale":"2022-05-02T09:42:22.265746+0000","last_undegraded":"2022-05-02T09:42:22.265746+0000","last_fullsized":"2022-05-02T09:42:22.265746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:03:31.072418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267838+0000","last_change":"2022-05-02T09:42:11.180999+0000","last_active":"2022-05-02T09:42:22.267838+0000","last_peered":"2022-05-02T09:42:22.267838+0000","last_clean":"2022-05-02T09:42:22.267838+0000","last_became_active":"2022-05-02T09:42:11.180544+0000","last_became_peered":"2022-05-02T09:42:11.180544+0000","last_unstale":"2022-05-02T09:42:22.267838+0000","last_undegraded":"2022-05-02T09:42:22.267838+0000","last_fullsized":"2022-05-02T09:42:22.267838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:28:23.768964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266161+0000","last_change":"2022-05-02T09:42:11.153463+0000","last_active":"2022-05-02T09:42:22.266161+0000","last_peered":"2022-05-02T09:42:22.266161+0000","last_clean":"2022-05-02T09:42:22.266161+0000","last_became_active":"2022-05-02T09:42:11.152403+0000","last_became_peered":"2022-05-02T09:42:11.152403+0000","last_unstale":"2022-05-02T09:42:22.266161+0000","last_undegraded":"2022-05-02T09:42:22.266161+0000","last_fullsized":"2022-05-02T09:42:22.266161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:43:48.199163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266573+0000","last_change":"2022-05-02T09:42:11.157828+0000","last_active":"2022-05-02T09:42:22.266573+0000","last_peered":"2022-05-02T09:42:22.266573+0000","last_clean":"2022-05-02T09:42:22.266573+0000","last_became_active":"2022-05-02T09:42:11.153120+0000","last_became_peered":"2022-05-02T09:42:11.153120+0000","last_unstale":"2022-05-02T09:42:22.266573+0000","last_undegraded":"2022-05-02T09:42:22.266573+0000","last_fullsized":"2022-05-02T09:42:22.266573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:59:09.978347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235829+0000","last_change":"2022-05-02T09:42:11.141726+0000","last_active":"2022-05-02T09:42:22.235829+0000","last_peered":"2022-05-02T09:42:22.235829+0000","last_clean":"2022-05-02T09:42:22.235829+0000","last_became_active":"2022-05-02T09:42:11.141421+0000","last_became_peered":"2022-05-02T09:42:11.141421+0000","last_unstale":"2022-05-02T09:42:22.235829+0000","last_undegraded":"2022-05-02T09:42:22.235829+0000","last_fullsized":"2022-05-02T09:42:22.235829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:54:36.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234297+0000","last_change":"2022-05-02T09:42:11.147746+0000","last_active":"2022-05-02T09:42:22.234297+0000","last_peered":"2022-05-02T09:42:22.234297+0000","last_clean":"2022-05-02T09:42:22.234297+0000","last_became_active":"2022-05-02T09:42:11.143406+0000","last_became_peered":"2022-05-02T09:42:11.143406+0000","last_unstale":"2022-05-02T09:42:22.234297+0000","last_undegraded":"2022-05-02T09:42:22.234297+0000","last_fullsized":"2022-05-02T09:42:22.234297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:49:19.866673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265901+0000","last_change":"2022-05-02T09:42:11.161411+0000","last_active":"2022-05-02T09:42:22.265901+0000","last_peered":"2022-05-02T09:42:22.265901+0000","last_clean":"2022-05-02T09:42:22.265901+0000","last_became_active":"2022-05-02T09:42:11.160615+0000","last_became_peered":"2022-05-02T09:42:11.160615+0000","last_unstale":"2022-05-02T09:42:22.265901+0000","last_undegraded":"2022-05-02T09:42:22.265901+0000","last_fullsized":"2022-05-02T09:42:22.265901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:53:43.703274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266445+0000","last_change":"2022-05-02T09:42:11.142366+0000","last_active":"2022-05-02T09:42:22.266445+0000","last_peered":"2022-05-02T09:42:22.266445+0000","last_clean":"2022-05-02T09:42:22.266445+0000","last_became_active":"2022-05-02T09:42:11.142053+0000","last_became_peered":"2022-05-02T09:42:11.142053+0000","last_unstale":"2022-05-02T09:42:22.266445+0000","last_undegraded":"2022-05-02T09:42:22.266445+0000","last_fullsized":"2022-05-02T09:42:22.266445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:33:10.753385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232958+0000","last_change":"2022-05-02T09:42:11.131814+0000","last_active":"2022-05-02T09:42:22.232958+0000","last_peered":"2022-05-02T09:42:22.232958+0000","last_clean":"2022-05-02T09:42:22.232958+0000","last_became_active":"2022-05-02T09:42:11.131514+0000","last_became_peered":"2022-05-02T09:42:11.131514+0000","last_unstale":"2022-05-02T09:42:22.232958+0000","last_undegraded":"2022-05-02T09:42:22.232958+0000","last_fullsized":"2022-05-02T09:42:22.232958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:14:43.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267960+0000","last_change":"2022-05-02T09:42:11.181581+0000","last_active":"2022-05-02T09:42:22.267960+0000","last_peered":"2022-05-02T09:42:22.267960+0000","last_clean":"2022-05-02T09:42:22.267960+0000","last_became_active":"2022-05-02T09:42:11.181302+0000","last_became_peered":"2022-05-02T09:42:11.181302+0000","last_unstale":"2022-05-02T09:42:22.267960+0000","last_undegraded":"2022-05-02T09:42:22.267960+0000","last_fullsized":"2022-05-02T09:42:22.267960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:20:35.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266753+0000","last_change":"2022-05-02T09:42:11.163743+0000","last_active":"2022-05-02T09:42:22.266753+0000","last_peered":"2022-05-02T09:42:22.266753+0000","last_clean":"2022-05-02T09:42:22.266753+0000","last_became_active":"2022-05-02T09:42:11.163439+0000","last_became_peered":"2022-05-02T09:42:11.163439+0000","last_unstale":"2022-05-02T09:42:22.266753+0000","last_undegraded":"2022-05-02T09:42:22.266753+0000","last_fullsized":"2022-05-02T09:42:22.266753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:05:11.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234458+0000","last_change":"2022-05-02T09:42:11.155107+0000","last_active":"2022-05-02T09:42:22.234458+0000","last_peered":"2022-05-02T09:42:22.234458+0000","last_clean":"2022-05-02T09:42:22.234458+0000","last_became_active":"2022-05-02T09:42:11.154333+0000","last_became_peered":"2022-05-02T09:42:11.154333+0000","last_unstale":"2022-05-02T09:42:22.234458+0000","last_undegraded":"2022-05-02T09:42:22.234458+0000","last_fullsized":"2022-05-02T09:42:22.234458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:50:36.592256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266491+0000","last_change":"2022-05-02T09:42:11.137878+0000","last_active":"2022-05-02T09:42:22.266491+0000","last_peered":"2022-05-02T09:42:22.266491+0000","last_clean":"2022-05-02T09:42:22.266491+0000","last_became_active":"2022-05-02T09:42:11.137587+0000","last_became_peered":"2022-05-02T09:42:11.137587+0000","last_unstale":"2022-05-02T09:42:22.266491+0000","last_undegraded":"2022-05-02T09:42:22.266491+0000","last_fullsized":"2022-05-02T09:42:22.266491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T09:50:06.643669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266001+0000","last_change":"2022-05-02T09:42:11.161114+0000","last_active":"2022-05-02T09:42:22.266001+0000","last_peered":"2022-05-02T09:42:22.266001+0000","last_clean":"2022-05-02T09:42:22.266001+0000","last_became_active":"2022-05-02T09:42:11.160754+0000","last_became_peered":"2022-05-02T09:42:11.160754+0000","last_unstale":"2022-05-02T09:42:22.266001+0000","last_undegraded":"2022-05-02T09:42:22.266001+0000","last_fullsized":"2022-05-02T09:42:22.266001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:38:15.157653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266288+0000","last_change":"2022-05-02T09:42:11.138596+0000","last_active":"2022-05-02T09:42:22.266288+0000","last_peered":"2022-05-02T09:42:22.266288+0000","last_clean":"2022-05-02T09:42:22.266288+0000","last_became_active":"2022-05-02T09:42:11.138304+0000","last_became_peered":"2022-05-02T09:42:11.138304+0000","last_unstale":"2022-05-02T09:42:22.266288+0000","last_undegraded":"2022-05-02T09:42:22.266288+0000","last_fullsized":"2022-05-02T09:42:22.266288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:34:24.897058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233000+0000","last_change":"2022-05-02T09:42:11.160929+0000","last_active":"2022-05-02T09:42:22.233000+0000","last_peered":"2022-05-02T09:42:22.233000+0000","last_clean":"2022-05-02T09:42:22.233000+0000","last_became_active":"2022-05-02T09:42:11.160306+0000","last_became_peered":"2022-05-02T09:42:11.160306+0000","last_unstale":"2022-05-02T09:42:22.233000+0000","last_undegraded":"2022-05-02T09:42:22.233000+0000","last_fullsized":"2022-05-02T09:42:22.233000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:31:56.914858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265605+0000","last_change":"2022-05-02T09:42:11.167545+0000","last_active":"2022-05-02T09:42:22.265605+0000","last_peered":"2022-05-02T09:42:22.265605+0000","last_clean":"2022-05-02T09:42:22.265605+0000","last_became_active":"2022-05-02T09:42:11.166875+0000","last_became_peered":"2022-05-02T09:42:11.166875+0000","last_unstale":"2022-05-02T09:42:22.265605+0000","last_undegraded":"2022-05-02T09:42:22.265605+0000","last_fullsized":"2022-05-02T09:42:22.265605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:29:59.177436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267096+0000","last_change":"2022-05-02T09:42:11.168881+0000","last_active":"2022-05-02T09:42:22.267096+0000","last_peered":"2022-05-02T09:42:22.267096+0000","last_clean":"2022-05-02T09:42:22.267096+0000","last_became_active":"2022-05-02T09:42:11.168197+0000","last_became_peered":"2022-05-02T09:42:11.168197+0000","last_unstale":"2022-05-02T09:42:22.267096+0000","last_undegraded":"2022-05-02T09:42:22.267096+0000","last_fullsized":"2022-05-02T09:42:22.267096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:18:58.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266487+0000","last_change":"2022-05-02T09:42:11.160921+0000","last_active":"2022-05-02T09:42:22.266487+0000","last_peered":"2022-05-02T09:42:22.266487+0000","last_clean":"2022-05-02T09:42:22.266487+0000","last_became_active":"2022-05-02T09:42:11.160324+0000","last_became_peered":"2022-05-02T09:42:11.160324+0000","last_unstale":"2022-05-02T09:42:22.266487+0000","last_undegraded":"2022-05-02T09:42:22.266487+0000","last_fullsized":"2022-05-02T09:42:22.266487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:45:49.403381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235713+0000","last_change":"2022-05-02T09:42:11.141985+0000","last_active":"2022-05-02T09:42:22.235713+0000","last_peered":"2022-05-02T09:42:22.235713+0000","last_clean":"2022-05-02T09:42:22.235713+0000","last_became_active":"2022-05-02T09:42:11.135147+0000","last_became_peered":"2022-05-02T09:42:11.135147+0000","last_unstale":"2022-05-02T09:42:22.235713+0000","last_undegraded":"2022-05-02T09:42:22.235713+0000","last_fullsized":"2022-05-02T09:42:22.235713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:14:32.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"35'2","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266142+0000","last_change":"2022-05-02T09:42:11.161873+0000","last_active":"2022-05-02T09:42:22.266142+0000","last_peered":"2022-05-02T09:42:22.266142+0000","last_clean":"2022-05-02T09:42:22.266142+0000","last_became_active":"2022-05-02T09:42:11.161081+0000","last_became_peered":"2022-05-02T09:42:11.161081+0000","last_unstale":"2022-05-02T09:42:22.266142+0000","last_undegraded":"2022-05-02T09:42:22.266142+0000","last_fullsized":"2022-05-02T09:42:22.266142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:00:42.184422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236122+0000","last_change":"2022-05-02T09:42:11.170335+0000","last_active":"2022-05-02T09:42:22.236122+0000","last_peered":"2022-05-02T09:42:22.236122+0000","last_clean":"2022-05-02T09:42:22.236122+0000","last_became_active":"2022-05-02T09:42:11.166918+0000","last_became_peered":"2022-05-02T09:42:11.166918+0000","last_unstale":"2022-05-02T09:42:22.236122+0000","last_undegraded":"2022-05-02T09:42:22.236122+0000","last_fullsized":"2022-05-02T09:42:22.236122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:38:06.142566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265736+0000","last_change":"2022-05-02T09:42:11.137964+0000","last_active":"2022-05-02T09:42:22.265736+0000","last_peered":"2022-05-02T09:42:22.265736+0000","last_clean":"2022-05-02T09:42:22.265736+0000","last_became_active":"2022-05-02T09:42:11.137281+0000","last_became_peered":"2022-05-02T09:42:11.137281+0000","last_unstale":"2022-05-02T09:42:22.265736+0000","last_undegraded":"2022-05-02T09:42:22.265736+0000","last_fullsized":"2022-05-02T09:42:22.265736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:19:19.251970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267106+0000","last_change":"2022-05-02T09:42:11.150934+0000","last_active":"2022-05-02T09:42:22.267106+0000","last_peered":"2022-05-02T09:42:22.267106+0000","last_clean":"2022-05-02T09:42:22.267106+0000","last_became_active":"2022-05-02T09:42:11.150285+0000","last_became_peered":"2022-05-02T09:42:11.150285+0000","last_unstale":"2022-05-02T09:42:22.267106+0000","last_undegraded":"2022-05-02T09:42:22.267106+0000","last_fullsized":"2022-05-02T09:42:22.267106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:57:23.186493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233362+0000","last_change":"2022-05-02T09:42:11.146037+0000","last_active":"2022-05-02T09:42:22.233362+0000","last_peered":"2022-05-02T09:42:22.233362+0000","last_clean":"2022-05-02T09:42:22.233362+0000","last_became_active":"2022-05-02T09:42:11.135507+0000","last_became_peered":"2022-05-02T09:42:11.135507+0000","last_unstale":"2022-05-02T09:42:22.233362+0000","last_undegraded":"2022-05-02T09:42:22.233362+0000","last_fullsized":"2022-05-02T09:42:22.233362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:06:49.638907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234576+0000","last_change":"2022-05-02T09:42:11.139575+0000","last_active":"2022-05-02T09:42:22.234576+0000","last_peered":"2022-05-02T09:42:22.234576+0000","last_clean":"2022-05-02T09:42:22.234576+0000","last_became_active":"2022-05-02T09:42:11.138741+0000","last_became_peered":"2022-05-02T09:42:11.138741+0000","last_unstale":"2022-05-02T09:42:22.234576+0000","last_undegraded":"2022-05-02T09:42:22.234576+0000","last_fullsized":"2022-05-02T09:42:22.234576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:09:58.179601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'8","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267906+0000","last_change":"2022-05-02T09:42:11.181189+0000","last_active":"2022-05-02T09:42:22.267906+0000","last_peered":"2022-05-02T09:42:22.267906+0000","last_clean":"2022-05-02T09:42:22.267906+0000","last_became_active":"2022-05-02T09:42:11.180631+0000","last_became_peered":"2022-05-02T09:42:11.180631+0000","last_unstale":"2022-05-02T09:42:22.267906+0000","last_undegraded":"2022-05-02T09:42:22.267906+0000","last_fullsized":"2022-05-02T09:42:22.267906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:55:49.201370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233263+0000","last_change":"2022-05-02T09:42:11.147467+0000","last_active":"2022-05-02T09:42:22.233263+0000","last_peered":"2022-05-02T09:42:22.233263+0000","last_clean":"2022-05-02T09:42:22.233263+0000","last_became_active":"2022-05-02T09:42:11.146915+0000","last_became_peered":"2022-05-02T09:42:11.146915+0000","last_unstale":"2022-05-02T09:42:22.233263+0000","last_undegraded":"2022-05-02T09:42:22.233263+0000","last_fullsized":"2022-05-02T09:42:22.233263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:11:26.060865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234132+0000","last_change":"2022-05-02T09:42:11.157177+0000","last_active":"2022-05-02T09:42:22.234132+0000","last_peered":"2022-05-02T09:42:22.234132+0000","last_clean":"2022-05-02T09:42:22.234132+0000","last_became_active":"2022-05-02T09:42:11.156863+0000","last_became_peered":"2022-05-02T09:42:11.156863+0000","last_unstale":"2022-05-02T09:42:22.234132+0000","last_undegraded":"2022-05-02T09:42:22.234132+0000","last_fullsized":"2022-05-02T09:42:22.234132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:00:52.784510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233730+0000","last_change":"2022-05-02T09:42:11.160362+0000","last_active":"2022-05-02T09:42:22.233730+0000","last_peered":"2022-05-02T09:42:22.233730+0000","last_clean":"2022-05-02T09:42:22.233730+0000","last_became_active":"2022-05-02T09:42:11.159326+0000","last_became_peered":"2022-05-02T09:42:11.159326+0000","last_unstale":"2022-05-02T09:42:22.233730+0000","last_undegraded":"2022-05-02T09:42:22.233730+0000","last_fullsized":"2022-05-02T09:42:22.233730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:42:17.406804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267420+0000","last_change":"2022-05-02T09:42:11.149256+0000","last_active":"2022-05-02T09:42:22.267420+0000","last_peered":"2022-05-02T09:42:22.267420+0000","last_clean":"2022-05-02T09:42:22.267420+0000","last_became_active":"2022-05-02T09:42:11.148401+0000","last_became_peered":"2022-05-02T09:42:11.148401+0000","last_unstale":"2022-05-02T09:42:22.267420+0000","last_undegraded":"2022-05-02T09:42:22.267420+0000","last_fullsized":"2022-05-02T09:42:22.267420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:20:13.943825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266447+0000","last_change":"2022-05-02T09:42:11.137531+0000","last_active":"2022-05-02T09:42:22.266447+0000","last_peered":"2022-05-02T09:42:22.266447+0000","last_clean":"2022-05-02T09:42:22.266447+0000","last_became_active":"2022-05-02T09:42:11.136740+0000","last_became_peered":"2022-05-02T09:42:11.136740+0000","last_unstale":"2022-05-02T09:42:22.266447+0000","last_undegraded":"2022-05-02T09:42:22.266447+0000","last_fullsized":"2022-05-02T09:42:22.266447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:12:53.196326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"35'19","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234761+0000","last_change":"2022-05-02T09:42:11.141461+0000","last_active":"2022-05-02T09:42:22.234761+0000","last_peered":"2022-05-02T09:42:22.234761+0000","last_clean":"2022-05-02T09:42:22.234761+0000","last_became_active":"2022-05-02T09:42:11.141012+0000","last_became_peered":"2022-05-02T09:42:11.141012+0000","last_unstale":"2022-05-02T09:42:22.234761+0000","last_undegraded":"2022-05-02T09:42:22.234761+0000","last_fullsized":"2022-05-02T09:42:22.234761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:35:53.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234201+0000","last_change":"2022-05-02T09:42:11.149968+0000","last_active":"2022-05-02T09:42:22.234201+0000","last_peered":"2022-05-02T09:42:22.234201+0000","last_clean":"2022-05-02T09:42:22.234201+0000","last_became_active":"2022-05-02T09:42:11.144166+0000","last_became_peered":"2022-05-02T09:42:11.144166+0000","last_unstale":"2022-05-02T09:42:22.234201+0000","last_undegraded":"2022-05-02T09:42:22.234201+0000","last_fullsized":"2022-05-02T09:42:22.234201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:06:54.193820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234090+0000","last_change":"2022-05-02T09:42:11.158283+0000","last_active":"2022-05-02T09:42:22.234090+0000","last_peered":"2022-05-02T09:42:22.234090+0000","last_clean":"2022-05-02T09:42:22.234090+0000","last_became_active":"2022-05-02T09:42:11.147007+0000","last_became_peered":"2022-05-02T09:42:11.147007+0000","last_unstale":"2022-05-02T09:42:22.234090+0000","last_undegraded":"2022-05-02T09:42:22.234090+0000","last_fullsized":"2022-05-02T09:42:22.234090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:48:46.677755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234812+0000","last_change":"2022-05-02T09:42:11.136965+0000","last_active":"2022-05-02T09:42:22.234812+0000","last_peered":"2022-05-02T09:42:22.234812+0000","last_clean":"2022-05-02T09:42:22.234812+0000","last_became_active":"2022-05-02T09:42:11.136611+0000","last_became_peered":"2022-05-02T09:42:11.136611+0000","last_unstale":"2022-05-02T09:42:22.234812+0000","last_undegraded":"2022-05-02T09:42:22.234812+0000","last_fullsized":"2022-05-02T09:42:22.234812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:00:46.212551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266407+0000","last_change":"2022-05-02T09:42:11.147333+0000","last_active":"2022-05-02T09:42:22.266407+0000","last_peered":"2022-05-02T09:42:22.266407+0000","last_clean":"2022-05-02T09:42:22.266407+0000","last_became_active":"2022-05-02T09:42:11.146921+0000","last_became_peered":"2022-05-02T09:42:11.146921+0000","last_unstale":"2022-05-02T09:42:22.266407+0000","last_undegraded":"2022-05-02T09:42:22.266407+0000","last_fullsized":"2022-05-02T09:42:22.266407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:55:15.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236149+0000","last_change":"2022-05-02T09:42:11.142219+0000","last_active":"2022-05-02T09:42:22.236149+0000","last_peered":"2022-05-02T09:42:22.236149+0000","last_clean":"2022-05-02T09:42:22.236149+0000","last_became_active":"2022-05-02T09:42:11.141628+0000","last_became_peered":"2022-05-02T09:42:11.141628+0000","last_unstale":"2022-05-02T09:42:22.236149+0000","last_undegraded":"2022-05-02T09:42:22.236149+0000","last_fullsized":"2022-05-02T09:42:22.236149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:19:13.784674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232727+0000","last_change":"2022-05-02T09:42:11.172785+0000","last_active":"2022-05-02T09:42:22.232727+0000","last_peered":"2022-05-02T09:42:22.232727+0000","last_clean":"2022-05-02T09:42:22.232727+0000","last_became_active":"2022-05-02T09:42:11.172114+0000","last_became_peered":"2022-05-02T09:42:11.172114+0000","last_unstale":"2022-05-02T09:42:22.232727+0000","last_undegraded":"2022-05-02T09:42:22.232727+0000","last_fullsized":"2022-05-02T09:42:22.232727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:58:01.906419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267235+0000","last_change":"2022-05-02T09:42:11.178041+0000","last_active":"2022-05-02T09:42:22.267235+0000","last_peered":"2022-05-02T09:42:22.267235+0000","last_clean":"2022-05-02T09:42:22.267235+0000","last_became_active":"2022-05-02T09:42:11.177747+0000","last_became_peered":"2022-05-02T09:42:11.177747+0000","last_unstale":"2022-05-02T09:42:22.267235+0000","last_undegraded":"2022-05-02T09:42:22.267235+0000","last_fullsized":"2022-05-02T09:42:22.267235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:49:38.923017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267555+0000","last_change":"2022-05-02T09:42:11.155858+0000","last_active":"2022-05-02T09:42:22.267555+0000","last_peered":"2022-05-02T09:42:22.267555+0000","last_clean":"2022-05-02T09:42:22.267555+0000","last_became_active":"2022-05-02T09:42:11.152700+0000","last_became_peered":"2022-05-02T09:42:11.152700+0000","last_unstale":"2022-05-02T09:42:22.267555+0000","last_undegraded":"2022-05-02T09:42:22.267555+0000","last_fullsized":"2022-05-02T09:42:22.267555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:51:01.329686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234305+0000","last_change":"2022-05-02T09:42:11.139177+0000","last_active":"2022-05-02T09:42:22.234305+0000","last_peered":"2022-05-02T09:42:22.234305+0000","last_clean":"2022-05-02T09:42:22.234305+0000","last_became_active":"2022-05-02T09:42:11.138148+0000","last_became_peered":"2022-05-02T09:42:11.138148+0000","last_unstale":"2022-05-02T09:42:22.234305+0000","last_undegraded":"2022-05-02T09:42:22.234305+0000","last_fullsized":"2022-05-02T09:42:22.234305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:45:20.078555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267775+0000","last_change":"2022-05-02T09:42:11.156276+0000","last_active":"2022-05-02T09:42:22.267775+0000","last_peered":"2022-05-02T09:42:22.267775+0000","last_clean":"2022-05-02T09:42:22.267775+0000","last_became_active":"2022-05-02T09:42:11.155655+0000","last_became_peered":"2022-05-02T09:42:11.155655+0000","last_unstale":"2022-05-02T09:42:22.267775+0000","last_undegraded":"2022-05-02T09:42:22.267775+0000","last_fullsized":"2022-05-02T09:42:22.267775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:32:28.346794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233065+0000","last_change":"2022-05-02T09:42:11.147252+0000","last_active":"2022-05-02T09:42:22.233065+0000","last_peered":"2022-05-02T09:42:22.233065+0000","last_clean":"2022-05-02T09:42:22.233065+0000","last_became_active":"2022-05-02T09:42:11.146464+0000","last_became_peered":"2022-05-02T09:42:11.146464+0000","last_unstale":"2022-05-02T09:42:22.233065+0000","last_undegraded":"2022-05-02T09:42:22.233065+0000","last_fullsized":"2022-05-02T09:42:22.233065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:45:33.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234500+0000","last_change":"2022-05-02T09:42:11.159110+0000","last_active":"2022-05-02T09:42:22.234500+0000","last_peered":"2022-05-02T09:42:22.234500+0000","last_clean":"2022-05-02T09:42:22.234500+0000","last_became_active":"2022-05-02T09:42:11.158793+0000","last_became_peered":"2022-05-02T09:42:11.158793+0000","last_unstale":"2022-05-02T09:42:22.234500+0000","last_undegraded":"2022-05-02T09:42:22.234500+0000","last_fullsized":"2022-05-02T09:42:22.234500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:34:35.779441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265983+0000","last_change":"2022-05-02T09:42:11.138209+0000","last_active":"2022-05-02T09:42:22.265983+0000","last_peered":"2022-05-02T09:42:22.265983+0000","last_clean":"2022-05-02T09:42:22.265983+0000","last_became_active":"2022-05-02T09:42:11.137685+0000","last_became_peered":"2022-05-02T09:42:11.137685+0000","last_unstale":"2022-05-02T09:42:22.265983+0000","last_undegraded":"2022-05-02T09:42:22.265983+0000","last_fullsized":"2022-05-02T09:42:22.265983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:15:13.380366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235578+0000","last_change":"2022-05-02T09:42:11.167527+0000","last_active":"2022-05-02T09:42:22.235578+0000","last_peered":"2022-05-02T09:42:22.235578+0000","last_clean":"2022-05-02T09:42:22.235578+0000","last_became_active":"2022-05-02T09:42:11.166183+0000","last_became_peered":"2022-05-02T09:42:11.166183+0000","last_unstale":"2022-05-02T09:42:22.235578+0000","last_undegraded":"2022-05-02T09:42:22.235578+0000","last_fullsized":"2022-05-02T09:42:22.235578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:07:21.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234958+0000","last_change":"2022-05-02T09:42:11.142739+0000","last_active":"2022-05-02T09:42:22.234958+0000","last_peered":"2022-05-02T09:42:22.234958+0000","last_clean":"2022-05-02T09:42:22.234958+0000","last_became_active":"2022-05-02T09:42:11.142021+0000","last_became_peered":"2022-05-02T09:42:11.142021+0000","last_unstale":"2022-05-02T09:42:22.234958+0000","last_undegraded":"2022-05-02T09:42:22.234958+0000","last_fullsized":"2022-05-02T09:42:22.234958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:17:06.039982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266916+0000","last_change":"2022-05-02T09:42:11.177948+0000","last_active":"2022-05-02T09:42:22.266916+0000","last_peered":"2022-05-02T09:42:22.266916+0000","last_clean":"2022-05-02T09:42:22.266916+0000","last_became_active":"2022-05-02T09:42:11.177629+0000","last_became_peered":"2022-05-02T09:42:11.177629+0000","last_unstale":"2022-05-02T09:42:22.266916+0000","last_undegraded":"2022-05-02T09:42:22.266916+0000","last_fullsized":"2022-05-02T09:42:22.266916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:03:22.945167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266957+0000","last_change":"2022-05-02T09:42:11.144154+0000","last_active":"2022-05-02T09:42:22.266957+0000","last_peered":"2022-05-02T09:42:22.266957+0000","last_clean":"2022-05-02T09:42:22.266957+0000","last_became_active":"2022-05-02T09:42:11.143871+0000","last_became_peered":"2022-05-02T09:42:11.143871+0000","last_unstale":"2022-05-02T09:42:22.266957+0000","last_undegraded":"2022-05-02T09:42:22.266957+0000","last_fullsized":"2022-05-02T09:42:22.266957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:18:37.067130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"35'5","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233947+0000","last_change":"2022-05-02T09:42:11.148418+0000","last_active":"2022-05-02T09:42:22.233947+0000","last_peered":"2022-05-02T09:42:22.233947+0000","last_clean":"2022-05-02T09:42:22.233947+0000","last_became_active":"2022-05-02T09:42:11.147491+0000","last_became_peered":"2022-05-02T09:42:11.147491+0000","last_unstale":"2022-05-02T09:42:22.233947+0000","last_undegraded":"2022-05-02T09:42:22.233947+0000","last_fullsized":"2022-05-02T09:42:22.233947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:09:41.112026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267020+0000","last_change":"2022-05-02T09:42:11.177932+0000","last_active":"2022-05-02T09:42:22.267020+0000","last_peered":"2022-05-02T09:42:22.267020+0000","last_clean":"2022-05-02T09:42:22.267020+0000","last_became_active":"2022-05-02T09:42:11.177612+0000","last_became_peered":"2022-05-02T09:42:11.177612+0000","last_unstale":"2022-05-02T09:42:22.267020+0000","last_undegraded":"2022-05-02T09:42:22.267020+0000","last_fullsized":"2022-05-02T09:42:22.267020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:21:49.840148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235028+0000","last_change":"2022-05-02T09:42:11.136832+0000","last_active":"2022-05-02T09:42:22.235028+0000","last_peered":"2022-05-02T09:42:22.235028+0000","last_clean":"2022-05-02T09:42:22.235028+0000","last_became_active":"2022-05-02T09:42:11.136081+0000","last_became_peered":"2022-05-02T09:42:11.136081+0000","last_unstale":"2022-05-02T09:42:22.235028+0000","last_undegraded":"2022-05-02T09:42:22.235028+0000","last_fullsized":"2022-05-02T09:42:22.235028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:22:04.741407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235934+0000","last_change":"2022-05-02T09:42:11.170348+0000","last_active":"2022-05-02T09:42:22.235934+0000","last_peered":"2022-05-02T09:42:22.235934+0000","last_clean":"2022-05-02T09:42:22.235934+0000","last_became_active":"2022-05-02T09:42:11.167266+0000","last_became_peered":"2022-05-02T09:42:11.167266+0000","last_unstale":"2022-05-02T09:42:22.235934+0000","last_undegraded":"2022-05-02T09:42:22.235934+0000","last_fullsized":"2022-05-02T09:42:22.235934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:15:30.411426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233969+0000","last_change":"2022-05-02T09:42:11.159622+0000","last_active":"2022-05-02T09:42:22.233969+0000","last_peered":"2022-05-02T09:42:22.233969+0000","last_clean":"2022-05-02T09:42:22.233969+0000","last_became_active":"2022-05-02T09:42:11.157809+0000","last_became_peered":"2022-05-02T09:42:11.157809+0000","last_unstale":"2022-05-02T09:42:22.233969+0000","last_undegraded":"2022-05-02T09:42:22.233969+0000","last_fullsized":"2022-05-02T09:42:22.233969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:03:53.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234690+0000","last_change":"2022-05-02T09:42:11.145091+0000","last_active":"2022-05-02T09:42:22.234690+0000","last_peered":"2022-05-02T09:42:22.234690+0000","last_clean":"2022-05-02T09:42:22.234690+0000","last_became_active":"2022-05-02T09:42:11.144797+0000","last_became_peered":"2022-05-02T09:42:11.144797+0000","last_unstale":"2022-05-02T09:42:22.234690+0000","last_undegraded":"2022-05-02T09:42:22.234690+0000","last_fullsized":"2022-05-02T09:42:22.234690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:11:12.974478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232848+0000","last_change":"2022-05-02T09:42:11.147120+0000","last_active":"2022-05-02T09:42:22.232848+0000","last_peered":"2022-05-02T09:42:22.232848+0000","last_clean":"2022-05-02T09:42:22.232848+0000","last_became_active":"2022-05-02T09:42:11.146227+0000","last_became_peered":"2022-05-02T09:42:11.146227+0000","last_unstale":"2022-05-02T09:42:22.232848+0000","last_undegraded":"2022-05-02T09:42:22.232848+0000","last_fullsized":"2022-05-02T09:42:22.232848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:39:10.090806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267503+0000","last_change":"2022-05-02T09:42:11.168844+0000","last_active":"2022-05-02T09:42:22.267503+0000","last_peered":"2022-05-02T09:42:22.267503+0000","last_clean":"2022-05-02T09:42:22.267503+0000","last_became_active":"2022-05-02T09:42:11.167851+0000","last_became_peered":"2022-05-02T09:42:11.167851+0000","last_unstale":"2022-05-02T09:42:22.267503+0000","last_undegraded":"2022-05-02T09:42:22.267503+0000","last_fullsized":"2022-05-02T09:42:22.267503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:11:58.151521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266414+0000","last_change":"2022-05-02T09:42:11.145632+0000","last_active":"2022-05-02T09:42:22.266414+0000","last_peered":"2022-05-02T09:42:22.266414+0000","last_clean":"2022-05-02T09:42:22.266414+0000","last_became_active":"2022-05-02T09:42:11.145308+0000","last_became_peered":"2022-05-02T09:42:11.145308+0000","last_unstale":"2022-05-02T09:42:22.266414+0000","last_undegraded":"2022-05-02T09:42:22.266414+0000","last_fullsized":"2022-05-02T09:42:22.266414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:13:06.777121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234366+0000","last_change":"2022-05-02T09:42:11.155332+0000","last_active":"2022-05-02T09:42:22.234366+0000","last_peered":"2022-05-02T09:42:22.234366+0000","last_clean":"2022-05-02T09:42:22.234366+0000","last_became_active":"2022-05-02T09:42:11.154780+0000","last_became_peered":"2022-05-02T09:42:11.154780+0000","last_unstale":"2022-05-02T09:42:22.234366+0000","last_undegraded":"2022-05-02T09:42:22.234366+0000","last_fullsized":"2022-05-02T09:42:22.234366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:30:21.891270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266255+0000","last_change":"2022-05-02T09:42:11.137735+0000","last_active":"2022-05-02T09:42:22.266255+0000","last_peered":"2022-05-02T09:42:22.266255+0000","last_clean":"2022-05-02T09:42:22.266255+0000","last_became_active":"2022-05-02T09:42:11.137094+0000","last_became_peered":"2022-05-02T09:42:11.137094+0000","last_unstale":"2022-05-02T09:42:22.266255+0000","last_undegraded":"2022-05-02T09:42:22.266255+0000","last_fullsized":"2022-05-02T09:42:22.266255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:31:24.720103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235075+0000","last_change":"2022-05-02T09:42:11.137011+0000","last_active":"2022-05-02T09:42:22.235075+0000","last_peered":"2022-05-02T09:42:22.235075+0000","last_clean":"2022-05-02T09:42:22.235075+0000","last_became_active":"2022-05-02T09:42:11.136475+0000","last_became_peered":"2022-05-02T09:42:11.136475+0000","last_unstale":"2022-05-02T09:42:22.235075+0000","last_undegraded":"2022-05-02T09:42:22.235075+0000","last_fullsized":"2022-05-02T09:42:22.235075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T21:36:58.998012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266855+0000","last_change":"2022-05-02T09:42:11.163195+0000","last_active":"2022-05-02T09:42:22.266855+0000","last_peered":"2022-05-02T09:42:22.266855+0000","last_clean":"2022-05-02T09:42:22.266855+0000","last_became_active":"2022-05-02T09:42:11.162886+0000","last_became_peered":"2022-05-02T09:42:11.162886+0000","last_unstale":"2022-05-02T09:42:22.266855+0000","last_undegraded":"2022-05-02T09:42:22.266855+0000","last_fullsized":"2022-05-02T09:42:22.266855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T16:38:45.041691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266327+0000","last_change":"2022-05-02T09:42:11.165766+0000","last_active":"2022-05-02T09:42:22.266327+0000","last_peered":"2022-05-02T09:42:22.266327+0000","last_clean":"2022-05-02T09:42:22.266327+0000","last_became_active":"2022-05-02T09:42:11.160253+0000","last_became_peered":"2022-05-02T09:42:11.160253+0000","last_unstale":"2022-05-02T09:42:22.266327+0000","last_undegraded":"2022-05-02T09:42:22.266327+0000","last_fullsized":"2022-05-02T09:42:22.266327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:44:20.655344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234098+0000","last_change":"2022-05-02T09:42:11.159656+0000","last_active":"2022-05-02T09:42:22.234098+0000","last_peered":"2022-05-02T09:42:22.234098+0000","last_clean":"2022-05-02T09:42:22.234098+0000","last_became_active":"2022-05-02T09:42:11.143620+0000","last_became_peered":"2022-05-02T09:42:11.143620+0000","last_unstale":"2022-05-02T09:42:22.234098+0000","last_undegraded":"2022-05-02T09:42:22.234098+0000","last_fullsized":"2022-05-02T09:42:22.234098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:04:45.752771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267770+0000","last_change":"2022-05-02T09:42:11.162434+0000","last_active":"2022-05-02T09:42:22.267770+0000","last_peered":"2022-05-02T09:42:22.267770+0000","last_clean":"2022-05-02T09:42:22.267770+0000","last_became_active":"2022-05-02T09:42:11.161796+0000","last_became_peered":"2022-05-02T09:42:11.161796+0000","last_unstale":"2022-05-02T09:42:22.267770+0000","last_undegraded":"2022-05-02T09:42:22.267770+0000","last_fullsized":"2022-05-02T09:42:22.267770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:26:35.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267267+0000","last_change":"2022-05-02T09:42:11.152765+0000","last_active":"2022-05-02T09:42:22.267267+0000","last_peered":"2022-05-02T09:42:22.267267+0000","last_clean":"2022-05-02T09:42:22.267267+0000","last_became_active":"2022-05-02T09:42:11.152430+0000","last_became_peered":"2022-05-02T09:42:11.152430+0000","last_unstale":"2022-05-02T09:42:22.267267+0000","last_undegraded":"2022-05-02T09:42:22.267267+0000","last_fullsized":"2022-05-02T09:42:22.267267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:43:40.480738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233797+0000","last_change":"2022-05-02T09:42:11.142176+0000","last_active":"2022-05-02T09:42:22.233797+0000","last_peered":"2022-05-02T09:42:22.233797+0000","last_clean":"2022-05-02T09:42:22.233797+0000","last_became_active":"2022-05-02T09:42:11.141830+0000","last_became_peered":"2022-05-02T09:42:11.141830+0000","last_unstale":"2022-05-02T09:42:22.233797+0000","last_undegraded":"2022-05-02T09:42:22.233797+0000","last_fullsized":"2022-05-02T09:42:22.233797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T11:39:27.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.265600+0000","last_change":"2022-05-02T09:42:11.156053+0000","last_active":"2022-05-02T09:42:22.265600+0000","last_peered":"2022-05-02T09:42:22.265600+0000","last_clean":"2022-05-02T09:42:22.265600+0000","last_became_active":"2022-05-02T09:42:11.153177+0000","last_became_peered":"2022-05-02T09:42:11.153177+0000","last_unstale":"2022-05-02T09:42:22.265600+0000","last_undegraded":"2022-05-02T09:42:22.265600+0000","last_fullsized":"2022-05-02T09:42:22.265600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:50.461903+0000","last_clean_scrub_stamp":"2022-05-02T09:38:50.461903+0000","objects_scrubbed":0,"log_size":115,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:08:25.619990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":104,"num_write":157,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235317+0000","last_change":"2022-05-02T09:42:11.149487+0000","last_active":"2022-05-02T09:42:22.235317+0000","last_peered":"2022-05-02T09:42:22.235317+0000","last_clean":"2022-05-02T09:42:22.235317+0000","last_became_active":"2022-05-02T09:42:11.147756+0000","last_became_peered":"2022-05-02T09:42:11.147756+0000","last_unstale":"2022-05-02T09:42:22.235317+0000","last_undegraded":"2022-05-02T09:42:22.235317+0000","last_fullsized":"2022-05-02T09:42:22.235317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T14:35:42.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235864+0000","last_change":"2022-05-02T09:42:11.167964+0000","last_active":"2022-05-02T09:42:22.235864+0000","last_peered":"2022-05-02T09:42:22.235864+0000","last_clean":"2022-05-02T09:42:22.235864+0000","last_became_active":"2022-05-02T09:42:11.166560+0000","last_became_peered":"2022-05-02T09:42:11.166560+0000","last_unstale":"2022-05-02T09:42:22.235864+0000","last_undegraded":"2022-05-02T09:42:22.235864+0000","last_fullsized":"2022-05-02T09:42:22.235864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:40:49.146399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.232701+0000","last_change":"2022-05-02T09:42:11.146877+0000","last_active":"2022-05-02T09:42:22.232701+0000","last_peered":"2022-05-02T09:42:22.232701+0000","last_clean":"2022-05-02T09:42:22.232701+0000","last_became_active":"2022-05-02T09:42:11.146096+0000","last_became_peered":"2022-05-02T09:42:11.146096+0000","last_unstale":"2022-05-02T09:42:22.232701+0000","last_undegraded":"2022-05-02T09:42:22.232701+0000","last_fullsized":"2022-05-02T09:42:22.232701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T09:44:56.367461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266281+0000","last_change":"2022-05-02T09:42:11.169866+0000","last_active":"2022-05-02T09:42:22.266281+0000","last_peered":"2022-05-02T09:42:22.266281+0000","last_clean":"2022-05-02T09:42:22.266281+0000","last_became_active":"2022-05-02T09:42:11.169462+0000","last_became_peered":"2022-05-02T09:42:11.169462+0000","last_unstale":"2022-05-02T09:42:22.266281+0000","last_undegraded":"2022-05-02T09:42:22.266281+0000","last_fullsized":"2022-05-02T09:42:22.266281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:44:45.353405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267013+0000","last_change":"2022-05-02T09:42:11.150708+0000","last_active":"2022-05-02T09:42:22.267013+0000","last_peered":"2022-05-02T09:42:22.267013+0000","last_clean":"2022-05-02T09:42:22.267013+0000","last_became_active":"2022-05-02T09:42:11.149930+0000","last_became_peered":"2022-05-02T09:42:11.149930+0000","last_unstale":"2022-05-02T09:42:22.267013+0000","last_undegraded":"2022-05-02T09:42:22.267013+0000","last_fullsized":"2022-05-02T09:42:22.267013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:08:41.146130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235946+0000","last_change":"2022-05-02T09:42:11.142181+0000","last_active":"2022-05-02T09:42:22.235946+0000","last_peered":"2022-05-02T09:42:22.235946+0000","last_clean":"2022-05-02T09:42:22.235946+0000","last_became_active":"2022-05-02T09:42:11.141353+0000","last_became_peered":"2022-05-02T09:42:11.141353+0000","last_unstale":"2022-05-02T09:42:22.235946+0000","last_undegraded":"2022-05-02T09:42:22.235946+0000","last_fullsized":"2022-05-02T09:42:22.235946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:44:31.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266719+0000","last_change":"2022-05-02T09:42:11.166036+0000","last_active":"2022-05-02T09:42:22.266719+0000","last_peered":"2022-05-02T09:42:22.266719+0000","last_clean":"2022-05-02T09:42:22.266719+0000","last_became_active":"2022-05-02T09:42:11.161036+0000","last_became_peered":"2022-05-02T09:42:11.161036+0000","last_unstale":"2022-05-02T09:42:22.266719+0000","last_undegraded":"2022-05-02T09:42:22.266719+0000","last_fullsized":"2022-05-02T09:42:22.266719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:07:18.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267057+0000","last_change":"2022-05-02T09:42:11.169655+0000","last_active":"2022-05-02T09:42:22.267057+0000","last_peered":"2022-05-02T09:42:22.267057+0000","last_clean":"2022-05-02T09:42:22.267057+0000","last_became_active":"2022-05-02T09:42:11.169322+0000","last_became_peered":"2022-05-02T09:42:11.169322+0000","last_unstale":"2022-05-02T09:42:22.267057+0000","last_undegraded":"2022-05-02T09:42:22.267057+0000","last_fullsized":"2022-05-02T09:42:22.267057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T15:00:20.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234520+0000","last_change":"2022-05-02T09:42:11.139403+0000","last_active":"2022-05-02T09:42:22.234520+0000","last_peered":"2022-05-02T09:42:22.234520+0000","last_clean":"2022-05-02T09:42:22.234520+0000","last_became_active":"2022-05-02T09:42:11.138435+0000","last_became_peered":"2022-05-02T09:42:11.138435+0000","last_unstale":"2022-05-02T09:42:22.234520+0000","last_undegraded":"2022-05-02T09:42:22.234520+0000","last_fullsized":"2022-05-02T09:42:22.234520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:58:07.024496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266575+0000","last_change":"2022-05-02T09:42:11.153855+0000","last_active":"2022-05-02T09:42:22.266575+0000","last_peered":"2022-05-02T09:42:22.266575+0000","last_clean":"2022-05-02T09:42:22.266575+0000","last_became_active":"2022-05-02T09:42:11.153075+0000","last_became_peered":"2022-05-02T09:42:11.153075+0000","last_unstale":"2022-05-02T09:42:22.266575+0000","last_undegraded":"2022-05-02T09:42:22.266575+0000","last_fullsized":"2022-05-02T09:42:22.266575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:13:35.778812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233164+0000","last_change":"2022-05-02T09:42:11.147337+0000","last_active":"2022-05-02T09:42:22.233164+0000","last_peered":"2022-05-02T09:42:22.233164+0000","last_clean":"2022-05-02T09:42:22.233164+0000","last_became_active":"2022-05-02T09:42:11.146481+0000","last_became_peered":"2022-05-02T09:42:11.146481+0000","last_unstale":"2022-05-02T09:42:22.233164+0000","last_undegraded":"2022-05-02T09:42:22.233164+0000","last_fullsized":"2022-05-02T09:42:22.233164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:07:05.053449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234247+0000","last_change":"2022-05-02T09:42:11.160454+0000","last_active":"2022-05-02T09:42:22.234247+0000","last_peered":"2022-05-02T09:42:22.234247+0000","last_clean":"2022-05-02T09:42:22.234247+0000","last_became_active":"2022-05-02T09:42:11.159571+0000","last_became_peered":"2022-05-02T09:42:11.159571+0000","last_unstale":"2022-05-02T09:42:22.234247+0000","last_undegraded":"2022-05-02T09:42:22.234247+0000","last_fullsized":"2022-05-02T09:42:22.234247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:38:59.568551+0000","last_clean_scrub_stamp":"2022-05-02T09:38:59.568551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:32:22.833040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267178+0000","last_change":"2022-05-02T09:42:11.151002+0000","last_active":"2022-05-02T09:42:22.267178+0000","last_peered":"2022-05-02T09:42:22.267178+0000","last_clean":"2022-05-02T09:42:22.267178+0000","last_became_active":"2022-05-02T09:42:11.150642+0000","last_became_peered":"2022-05-02T09:42:11.150642+0000","last_unstale":"2022-05-02T09:42:22.267178+0000","last_undegraded":"2022-05-02T09:42:22.267178+0000","last_fullsized":"2022-05-02T09:42:22.267178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:29:15.390097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233996+0000","last_change":"2022-05-02T09:42:11.162019+0000","last_active":"2022-05-02T09:42:22.233996+0000","last_peered":"2022-05-02T09:42:22.233996+0000","last_clean":"2022-05-02T09:42:22.233996+0000","last_became_active":"2022-05-02T09:42:11.144060+0000","last_became_peered":"2022-05-02T09:42:11.144060+0000","last_unstale":"2022-05-02T09:42:22.233996+0000","last_undegraded":"2022-05-02T09:42:22.233996+0000","last_fullsized":"2022-05-02T09:42:22.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:07:39.945818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'11","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267188+0000","last_change":"2022-05-02T09:42:11.178305+0000","last_active":"2022-05-02T09:42:22.267188+0000","last_peered":"2022-05-02T09:42:22.267188+0000","last_clean":"2022-05-02T09:42:22.267188+0000","last_became_active":"2022-05-02T09:42:11.177959+0000","last_became_peered":"2022-05-02T09:42:11.177959+0000","last_unstale":"2022-05-02T09:42:22.267188+0000","last_undegraded":"2022-05-02T09:42:22.267188+0000","last_fullsized":"2022-05-02T09:42:22.267188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:28:40.825170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.236139+0000","last_change":"2022-05-02T09:42:11.149580+0000","last_active":"2022-05-02T09:42:22.236139+0000","last_peered":"2022-05-02T09:42:22.236139+0000","last_clean":"2022-05-02T09:42:22.236139+0000","last_became_active":"2022-05-02T09:42:11.149285+0000","last_became_peered":"2022-05-02T09:42:11.149285+0000","last_unstale":"2022-05-02T09:42:22.236139+0000","last_undegraded":"2022-05-02T09:42:22.236139+0000","last_fullsized":"2022-05-02T09:42:22.236139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:50:09.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266153+0000","last_change":"2022-05-02T09:42:11.140860+0000","last_active":"2022-05-02T09:42:22.266153+0000","last_peered":"2022-05-02T09:42:22.266153+0000","last_clean":"2022-05-02T09:42:22.266153+0000","last_became_active":"2022-05-02T09:42:11.140505+0000","last_became_peered":"2022-05-02T09:42:11.140505+0000","last_unstale":"2022-05-02T09:42:22.266153+0000","last_undegraded":"2022-05-02T09:42:22.266153+0000","last_fullsized":"2022-05-02T09:42:22.266153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:02:58.994281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234396+0000","last_change":"2022-05-02T09:42:11.147934+0000","last_active":"2022-05-02T09:42:22.234396+0000","last_peered":"2022-05-02T09:42:22.234396+0000","last_clean":"2022-05-02T09:42:22.234396+0000","last_became_active":"2022-05-02T09:42:11.143773+0000","last_became_peered":"2022-05-02T09:42:11.143773+0000","last_unstale":"2022-05-02T09:42:22.234396+0000","last_undegraded":"2022-05-02T09:42:22.234396+0000","last_fullsized":"2022-05-02T09:42:22.234396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:14:48.313503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.235833+0000","last_change":"2022-05-02T09:42:11.142000+0000","last_active":"2022-05-02T09:42:22.235833+0000","last_peered":"2022-05-02T09:42:22.235833+0000","last_clean":"2022-05-02T09:42:22.235833+0000","last_became_active":"2022-05-02T09:42:11.135477+0000","last_became_peered":"2022-05-02T09:42:11.135477+0000","last_unstale":"2022-05-02T09:42:22.235833+0000","last_undegraded":"2022-05-02T09:42:22.235833+0000","last_fullsized":"2022-05-02T09:42:22.235833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T10:41:02.358136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234910+0000","last_change":"2022-05-02T09:42:11.142928+0000","last_active":"2022-05-02T09:42:22.234910+0000","last_peered":"2022-05-02T09:42:22.234910+0000","last_clean":"2022-05-02T09:42:22.234910+0000","last_became_active":"2022-05-02T09:42:11.142377+0000","last_became_peered":"2022-05-02T09:42:11.142377+0000","last_unstale":"2022-05-02T09:42:22.234910+0000","last_undegraded":"2022-05-02T09:42:22.234910+0000","last_fullsized":"2022-05-02T09:42:22.234910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:51:38.254463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234096+0000","last_change":"2022-05-02T09:42:11.165075+0000","last_active":"2022-05-02T09:42:22.234096+0000","last_peered":"2022-05-02T09:42:22.234096+0000","last_clean":"2022-05-02T09:42:22.234096+0000","last_became_active":"2022-05-02T09:42:11.164470+0000","last_became_peered":"2022-05-02T09:42:11.164470+0000","last_unstale":"2022-05-02T09:42:22.234096+0000","last_undegraded":"2022-05-02T09:42:22.234096+0000","last_fullsized":"2022-05-02T09:42:22.234096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T20:27:43.236423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233096+0000","last_change":"2022-05-02T09:42:11.172701+0000","last_active":"2022-05-02T09:42:22.233096+0000","last_peered":"2022-05-02T09:42:22.233096+0000","last_clean":"2022-05-02T09:42:22.233096+0000","last_became_active":"2022-05-02T09:42:11.171758+0000","last_became_peered":"2022-05-02T09:42:11.171758+0000","last_unstale":"2022-05-02T09:42:22.233096+0000","last_undegraded":"2022-05-02T09:42:22.233096+0000","last_fullsized":"2022-05-02T09:42:22.233096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T18:28:51.143802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"35'5","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267767+0000","last_change":"2022-05-02T09:42:11.157311+0000","last_active":"2022-05-02T09:42:22.267767+0000","last_peered":"2022-05-02T09:42:22.267767+0000","last_clean":"2022-05-02T09:42:22.267767+0000","last_became_active":"2022-05-02T09:42:11.157005+0000","last_became_peered":"2022-05-02T09:42:11.157005+0000","last_unstale":"2022-05-02T09:42:22.267767+0000","last_undegraded":"2022-05-02T09:42:22.267767+0000","last_fullsized":"2022-05-02T09:42:22.267767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:09.843651+0000","last_clean_scrub_stamp":"2022-05-02T09:39:09.843651+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T13:14:49.793124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233488+0000","last_change":"2022-05-02T09:42:11.148867+0000","last_active":"2022-05-02T09:42:22.233488+0000","last_peered":"2022-05-02T09:42:22.233488+0000","last_clean":"2022-05-02T09:42:22.233488+0000","last_became_active":"2022-05-02T09:42:11.148467+0000","last_became_peered":"2022-05-02T09:42:11.148467+0000","last_unstale":"2022-05-02T09:42:22.233488+0000","last_undegraded":"2022-05-02T09:42:22.233488+0000","last_fullsized":"2022-05-02T09:42:22.233488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:53:49.986739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.267645+0000","last_change":"2022-05-02T09:42:11.164352+0000","last_active":"2022-05-02T09:42:22.267645+0000","last_peered":"2022-05-02T09:42:22.267645+0000","last_clean":"2022-05-02T09:42:22.267645+0000","last_became_active":"2022-05-02T09:42:11.161475+0000","last_became_peered":"2022-05-02T09:42:11.161475+0000","last_unstale":"2022-05-02T09:42:22.267645+0000","last_undegraded":"2022-05-02T09:42:22.267645+0000","last_fullsized":"2022-05-02T09:42:22.267645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:16:17.690303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.233532+0000","last_change":"2022-05-02T09:42:11.143012+0000","last_active":"2022-05-02T09:42:22.233532+0000","last_peered":"2022-05-02T09:42:22.233532+0000","last_clean":"2022-05-02T09:42:22.233532+0000","last_became_active":"2022-05-02T09:42:11.142720+0000","last_became_peered":"2022-05-02T09:42:11.142720+0000","last_unstale":"2022-05-02T09:42:22.233532+0000","last_undegraded":"2022-05-02T09:42:22.233532+0000","last_fullsized":"2022-05-02T09:42:22.233532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T19:39:43.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266503+0000","last_change":"2022-05-02T09:42:11.147262+0000","last_active":"2022-05-02T09:42:22.266503+0000","last_peered":"2022-05-02T09:42:22.266503+0000","last_clean":"2022-05-02T09:42:22.266503+0000","last_became_active":"2022-05-02T09:42:11.146523+0000","last_became_peered":"2022-05-02T09:42:11.146523+0000","last_unstale":"2022-05-02T09:42:22.266503+0000","last_undegraded":"2022-05-02T09:42:22.266503+0000","last_fullsized":"2022-05-02T09:42:22.266503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:34:34.437245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.234499+0000","last_change":"2022-05-02T09:42:11.158825+0000","last_active":"2022-05-02T09:42:22.234499+0000","last_peered":"2022-05-02T09:42:22.234499+0000","last_clean":"2022-05-02T09:42:22.234499+0000","last_became_active":"2022-05-02T09:42:11.158405+0000","last_became_peered":"2022-05-02T09:42:11.158405+0000","last_unstale":"2022-05-02T09:42:22.234499+0000","last_undegraded":"2022-05-02T09:42:22.234499+0000","last_fullsized":"2022-05-02T09:42:22.234499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T17:58:11.481883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2022-05-02T09:42:22.266581+0000","last_change":"2022-05-02T09:42:11.165773+0000","last_active":"2022-05-02T09:42:22.266581+0000","last_peered":"2022-05-02T09:42:22.266581+0000","last_clean":"2022-05-02T09:42:22.266581+0000","last_became_active":"2022-05-02T09:42:11.160657+0000","last_became_peered":"2022-05-02T09:42:11.160657+0000","last_unstale":"2022-05-02T09:42:22.266581+0000","last_undegraded":"2022-05-02T09:42:22.266581+0000","last_fullsized":"2022-05-02T09:42:22.266581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-02T09:39:10.850827+0000","last_clean_scrub_stamp":"2022-05-02T09:39:10.850827+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-03T12:53:11.907264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8781,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":19,"num_read_kb":21,"num_write":116,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43617,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":104,"num_write":157,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3976,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":31,"seq":133143986182,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":352,"kb_used_omap":9,"kb_used_meta":7670,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":360448,"data_stored":153691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9631,"internal_metadata":7854689},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":1,"up_from":31,"seq":133143986182,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12896,"kb_used_data":920,"kb_used_omap":6,"kb_used_meta":11961,"kb_avail":94358944,"statfs":{"total":96636764160,"available":96623558656,"internally_reserved":0,"allocated":942080,"data_stored":739579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6299,"internal_metadata":12248933},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":31,"seq":133143986181,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12484,"kb_used_data":380,"kb_used_omap":12,"kb_used_meta":12083,"kb_avail":94359356,"statfs":{"total":96636764160,"available":96623980544,"internally_reserved":0,"allocated":389120,"data_stored":156772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12420,"internal_metadata":12373884},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":29,"seq":124554051590,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13044,"kb_used_data":940,"kb_used_omap":18,"kb_used_meta":12077,"kb_avail":94358796,"statfs":{"total":96636764160,"available":96623407104,"internally_reserved":0,"allocated":962560,"data_stored":742520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19244,"internal_metadata":12367060},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3976,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15267,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6299,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9631,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12420,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-02T09:42:27.962 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-05-02T09:42:27.963 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-05-02T09:42:27.963 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-05-02T09:42:27.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-05-02T09:42:28.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.181+0000 7fd9963ff700 1 Processor -- start 2022-05-02T09:42:28.184 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.181+0000 7fd9963ff700 1 -- start start 2022-05-02T09:42:28.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.182+0000 7fd9963ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 0x7fd9900b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.182+0000 7fd9963ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900689b0 0x7fd9901488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.182+0000 7fd9963ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900a2d30 con 0x7fd9900a3170 2022-05-02T09:42:28.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.182+0000 7fd9963ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900a3540 con 0x7fd9900a4280 2022-05-02T09:42:28.185 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.182+0000 7fd9963ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900a3aa0 con 0x7fd9900689b0 2022-05-02T09:42:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd9900a3170 0x7fd9900682a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52462/0 (socket says 172.21.15.50:52462) 2022-05-02T09:42:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98ffff700 1 -- 172.21.15.50:0/1998684501 learned_addr learned my addr 172.21.15.50:0/1998684501 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 0x7fd9900b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd99499c700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900689b0 0x7fd9901488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98f7fe700 1 -- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900689b0 msgr2=0x7fd9901488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:28.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900689b0 0x7fd9901488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98f7fe700 1 -- 172.21.15.50:0/1998684501 >> v1:172.21.15.50:6789/0 conn(0x7fd9900a3170 legacy=0x7fd9900682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98effd700 1 -- 172.21.15.50:0/1998684501 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520078998 0 0) 0x7fd9900a2d30 con 0x7fd9900a3170 2022-05-02T09:42:28.188 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.183+0000 7fd98f7fe700 1 -- 172.21.15.50:0/1998684501 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900b2350 con 0x7fd9900a4280 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.184+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 0x7fd9900b1e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd984009790 tx=0x7fd984009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2586e220e151b6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.184+0000 7fd98effd700 1 -- 172.21.15.50:0/1998684501 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011630 con 0x7fd9900a4280 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.184+0000 7fd98effd700 1 -- 172.21.15.50:0/1998684501 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd984011790 con 0x7fd9900a4280 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.184+0000 7fd98effd700 1 -- 172.21.15.50:0/1998684501 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011b30 con 0x7fd9900a4280 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 -- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 msgr2=0x7fd9900b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 0x7fd9900b1e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd984009790 tx=0x7fd984009060 comp rx=0 tx=0).stop 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 -- 172.21.15.50:0/1998684501 shutdown_connections 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900689b0 0x7fd9901488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 --2- 172.21.15.50:0/1998684501 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a4280 0x7fd9900b1e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 -- 172.21.15.50:0/1998684501 >> 172.21.15.50:0/1998684501 conn(0x7fd99006c920 msgr2=0x7fd99006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 -- 172.21.15.50:0/1998684501 shutdown_connections 2022-05-02T09:42:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.185+0000 7fd9963ff700 1 -- 172.21.15.50:0/1998684501 wait complete. 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.187+0000 7fd9963ff700 1 Processor -- start 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.187+0000 7fd9963ff700 1 -- start start 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 0x7fd99009a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 0x7fd990150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99009c860 con 0x7fd9900689b0 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99009aa00 con 0x7fd9900a3170 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.188+0000 7fd9963ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900973e0 con 0x7fd9900a4280 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36280/0 (socket says 172.21.15.50:36280) 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98ffff700 1 -- 172.21.15.50:0/70148998 learned_addr learned my addr 172.21.15.50:0/70148998 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 0x7fd99009a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd99499c700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 0x7fd990150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 -- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 msgr2=0x7fd990150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.194 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 0x7fd990150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 -- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 msgr2=0x7fd99009b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98f7fe700 1 -- 172.21.15.50:0/70148998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840092a0 con 0x7fd9900a3170 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd99499c700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 0x7fd990150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.189+0000 7fd98ffff700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd98f7fe700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 0x7fd99009a030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd984016000 tx=0x7fd984017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984004570 con 0x7fd9900a3170 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd984011900 con 0x7fd9900a3170 2022-05-02T09:42:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd990099c40 con 0x7fd9900a3170 2022-05-02T09:42:28.196 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98401a430 con 0x7fd9900a3170 2022-05-02T09:42:28.196 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.190+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd990098f70 con 0x7fd9900a3170 2022-05-02T09:42:28.197 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.191+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99004bfb0 con 0x7fd9900a3170 2022-05-02T09:42:28.197 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.192+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7fd98400f050 con 0x7fd9900a3170 2022-05-02T09:42:28.197 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.193+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd98405b0c0 con 0x7fd9900a3170 2022-05-02T09:42:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.196+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7fd984005de0 con 0x7fd9900a3170 2022-05-02T09:42:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.384+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd99006ee10 con 0x7fd9900a3170 2022-05-02T09:42:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.384+0000 7fd977fff700 1 -- 172.21.15.50:0/70148998 <== mon.1 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd984015070 con 0x7fd9900a3170 2022-05-02T09:42:28.387 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:28.387 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 >> v1:172.21.15.50:6800/36423 conn(0x7fd970044b40 legacy=0x7fd970046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 msgr2=0x7fd99009a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 0x7fd99009a030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd984016000 tx=0x7fd984017000 comp rx=0 tx=0).stop 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 shutdown_connections 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7fd9900a4280 0x7fd990150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9900689b0 0x7fd99009b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 --2- 172.21.15.50:0/70148998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9900a3170 0x7fd99009a030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 >> 172.21.15.50:0/70148998 conn(0x7fd99006c920 msgr2=0x7fd99006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 shutdown_connections 2022-05-02T09:42:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.386+0000 7fd9963ff700 1 -- 172.21.15.50:0/70148998 wait complete. 2022-05-02T09:42:28.413 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-05-02T09:42:28.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-02T09:42:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.631+0000 7f959afff700 1 Processor -- start 2022-05-02T09:42:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 -- start start 2022-05-02T09:42:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 0x7f95940689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 0x7f9594148c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9594069590 con 0x7f95940b1fd0 2022-05-02T09:42:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95940a2d30 con 0x7f95940a2fb0 2022-05-02T09:42:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.632+0000 7f959afff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b23a0 con 0x7f95941468b0 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f9593fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 0x7f95940689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f959959c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 0x7f9594148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f9598d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95940b1fd0 0x7f95940682a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52464/0 (socket says 172.21.15.50:52464) 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f9593fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 0x7f95940689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36282/0 (socket says 172.21.15.50:36282) 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f9598d9b700 1 -- 172.21.15.50:0/2329669873 learned_addr learned my addr 172.21.15.50:0/2329669873 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f959959c700 1 -- 172.21.15.50:0/2329669873 >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 msgr2=0x7f95940689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f959959c700 1 --2- 172.21.15.50:0/2329669873 >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 0x7f95940689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f959959c700 1 -- 172.21.15.50:0/2329669873 >> v1:172.21.15.50:6789/0 conn(0x7f95940b1fd0 legacy=0x7f95940682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.633+0000 7f959959c700 1 -- 172.21.15.50:0/2329669873 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940a24a0 con 0x7f95941468b0 2022-05-02T09:42:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.634+0000 7f959959c700 1 --2- 172.21.15.50:0/2329669873 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 0x7f9594148c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f958c009e60 tx=0x7f958c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8faae2e9f985b48d server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.634+0000 7f95937fe700 1 -- 172.21.15.50:0/2329669873 <== mon.1 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00e070 con 0x7f95941468b0 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.634+0000 7f95937fe700 1 -- 172.21.15.50:0/2329669873 <== mon.1 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00bbf0 con 0x7f95941468b0 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.634+0000 7f95937fe700 1 -- 172.21.15.50:0/2329669873 <== mon.1 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c012430 con 0x7f95941468b0 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 -- 172.21.15.50:0/2329669873 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 msgr2=0x7f9594148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 --2- 172.21.15.50:0/2329669873 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 0x7f9594148c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f958c009e60 tx=0x7f958c009780 comp rx=0 tx=0).stop 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 -- 172.21.15.50:0/2329669873 shutdown_connections 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 --2- 172.21.15.50:0/2329669873 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95941468b0 0x7f9594148c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 --2- 172.21.15.50:0/2329669873 >> v2:172.21.15.50:3300/0 conn(0x7f95940a2fb0 0x7f95940689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 -- 172.21.15.50:0/2329669873 >> 172.21.15.50:0/2329669873 conn(0x7f959406c920 msgr2=0x7f959406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 -- 172.21.15.50:0/2329669873 shutdown_connections 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.635+0000 7f959afff700 1 -- 172.21.15.50:0/2329669873 wait complete. 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.636+0000 7f959afff700 1 Processor -- start 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 -- start start 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 0x7f959414d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959414d460 con 0x7f95941468b0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9594097600 con 0x7f95940b1fd0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.637+0000 7f959afff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95940978e0 con 0x7f95940a2fb0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9593fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f959959c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 0x7f959414d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9593fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50838/0 (socket says 172.21.15.50:50838) 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50148/0 (socket says 172.21.15.50:50148) 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9593fff700 1 -- 172.21.15.50:0/945266293 learned_addr learned my addr 172.21.15.50:0/945266293 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 -- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 msgr2=0x7f9594097ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 -- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 msgr2=0x7f959414d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 0x7f959414d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9598d9b700 1 -- 172.21.15.50:0/945266293 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c009a20 con 0x7f95940a2fb0 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f959959c700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 0x7f959414d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.638+0000 7f9593fff700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f9598d9b700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f958800c410 tx=0x7f9588007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880070d0 con 0x7f95940a2fb0 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588007230 con 0x7f95940a2fb0 2022-05-02T09:42:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959414d650 con 0x7f95940a2fb0 2022-05-02T09:42:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880075d0 con 0x7f95940a2fb0 2022-05-02T09:42:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.639+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959414b0b0 con 0x7f95940a2fb0 2022-05-02T09:42:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.640+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95940b0c20 con 0x7f95940a2fb0 2022-05-02T09:42:28.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.641+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f9588019030 con 0x7f95940a2fb0 2022-05-02T09:42:28.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.641+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f95880589e0 con 0x7f95940a2fb0 2022-05-02T09:42:28.647 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.645+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f9588037a00 con 0x7f95940a2fb0 2022-05-02T09:42:28.807 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.805+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f959404bfb0 con 0x7f95940a2fb0 2022-05-02T09:42:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.806+0000 7f9590ff9700 1 -- 172.21.15.50:0/945266293 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11633 (secure 0 0 0) 0x7f9588017020 con 0x7f95940a2fb0 2022-05-02T09:42:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:28.808 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"7c52b71c-589c-4ac2-936d-4a721101e437","created":"2022-05-02T09:38:47.780270+0000","modified":"2022-05-02T09:42:23.229204+0000","last_up_change":"2022-05-02T09:42:10.107171+0000","last_in_change":"2022-05-02T09:38:55.533250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-02T09:38:50.430034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-02T09:38:59.234105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-05-02T09:39:08.938842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-05-02T09:39:10.323546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5052e124-3372-47ca-82bf-129e055505ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":38513}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":38513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":38513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":38513}]},"public_addr":"172.21.15.50:6801/38513","cluster_addr":"172.21.15.50:6802/38513","heartbeat_back_addr":"172.21.15.50:6804/38513","heartbeat_front_addr":"172.21.15.50:6803/38513","state":["exists","up"]},{"osd":1,"uuid":"977ab153-0005-4d17-87fd-513b8e54c8a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":38604}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":38604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":38604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":38604}]},"public_addr":"172.21.15.50:6805/38604","cluster_addr":"172.21.15.50:6806/38604","heartbeat_back_addr":"172.21.15.50:6808/38604","heartbeat_front_addr":"172.21.15.50:6807/38604","state":["exists","up"]},{"osd":2,"uuid":"967bcdc5-8577-484e-bdd1-09a1ccdcad37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":38708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":38708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":38708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":38708}]},"public_addr":"172.21.15.50:6809/38708","cluster_addr":"172.21.15.50:6810/38708","heartbeat_back_addr":"172.21.15.50:6812/38708","heartbeat_front_addr":"172.21.15.50:6811/38708","state":["exists","up"]},{"osd":3,"uuid":"14b35f6e-2868-4cbd-81c5-d6cb8807774f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":31,"up_thru":31,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":38853}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":38853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":38853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":38853}]},"public_addr":"172.21.15.50:6813/38853","cluster_addr":"172.21.15.50:6814/38853","heartbeat_back_addr":"172.21.15.50:6816/38853","heartbeat_front_addr":"172.21.15.50:6815/38853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.651875+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.700108+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.881733+0000","dead_epoch":26},{"osd":3,"down_stamp":"2022-05-02T09:42:03.626311+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-02T09:38:53.655162+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6819/3706979787":"2022-05-03T09:42:17.093955+0000","172.21.15.50:0/1390228452":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/59626694":"2022-05-03T09:41:50.599109+0000","172.21.15.50:0/4112136070":"2022-05-03T09:41:50.599109+0000","172.21.15.50:6800/30011":"2022-05-03T09:41:50.599109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 >> v1:172.21.15.50:6800/36423 conn(0x7f957c044b40 legacy=0x7f957c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 msgr2=0x7f9594096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f958800c410 tx=0x7f9588007d30 comp rx=0 tx=0).stop 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 shutdown_connections 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f95940a2fb0 0x7f9594096a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95941468b0 0x7f959414d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 --2- 172.21.15.50:0/945266293 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b1fd0 0x7f9594097ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 >> 172.21.15.50:0/945266293 conn(0x7f959406c920 msgr2=0x7f959406e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:28.812 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 shutdown_connections 2022-05-02T09:42:28.812 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:28.808+0000 7f959afff700 1 -- 172.21.15.50:0/945266293 wait complete. 2022-05-02T09:42:28.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-05-02T09:38:50.430034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-02T09:38:59.234105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-05-02T09:39:08.938842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-05-02T09:39:10.323546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-05-02T09:42:28.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-05-02T09:42:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.060+0000 7f79fa5ff700 1 Processor -- start 2022-05-02T09:42:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.060+0000 7f79fa5ff700 1 -- start start 2022-05-02T09:42:29.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79fa5ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79fa5ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.064 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79fa5ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40a9310 con 0x7f79f413dfe0 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79fa5ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40a90a0 con 0x7f79f413e790 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79fa5ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40a7fe0 con 0x7f79f40a9830 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79f3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79f3fff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50150/0 (socket says 172.21.15.50:50150) 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50840/0 (socket says 172.21.15.50:50840) 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.061+0000 7f79f3fff700 1 -- 172.21.15.50:0/2341240980 learned_addr learned my addr 172.21.15.50:0/2341240980 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f3fff700 1 -- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 msgr2=0x7f79f4140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f3fff700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f3fff700 1 -- 172.21.15.50:0/2341240980 >> v1:172.21.15.50:6789/0 conn(0x7f79f413dfe0 legacy=0x7f79f4141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f3fff700 1 -- 172.21.15.50:0/2341240980 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40a8280 con 0x7f79f40a9830 2022-05-02T09:42:29.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f37fe700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.066 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f3fff700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009830 tx=0x7f79e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c1171fa6a93439 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.062+0000 7f79f2ffd700 1 -- 172.21.15.50:0/2341240980 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4004030 con 0x7f79f40a9830 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79f2ffd700 1 -- 172.21.15.50:0/2341240980 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4004190 con 0x7f79f40a9830 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79f2ffd700 1 -- 172.21.15.50:0/2341240980 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011630 con 0x7f79f40a9830 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 -- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 msgr2=0x7f79f40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009830 tx=0x7f79e40090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 -- 172.21.15.50:0/2341240980 shutdown_connections 2022-05-02T09:42:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f40a9830 0x7f79f40a5800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/2341240980 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f413e790 0x7f79f4140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 -- 172.21.15.50:0/2341240980 >> 172.21.15.50:0/2341240980 conn(0x7f79f4062df0 msgr2=0x7f79f40631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 -- 172.21.15.50:0/2341240980 shutdown_connections 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.063+0000 7f79fa5ff700 1 -- 172.21.15.50:0/2341240980 wait complete. 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.065+0000 7f79fa5ff700 1 Processor -- start 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.065+0000 7f79fa5ff700 1 -- start start 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 0x7f79f40adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 0x7f79f40aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ae190 con 0x7f79f413dfe0 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ac660 con 0x7f79f40a9830 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79fa5ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4141bc0 con 0x7f79f413e790 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 0x7f79f40adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36286/0 (socket says 172.21.15.50:36286) 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f37fe700 1 -- 172.21.15.50:0/3640061048 learned_addr learned my addr 172.21.15.50:0/3640061048 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f8b9c700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 0x7f79f40aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.071 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.066+0000 7f79f37fe700 1 -- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 msgr2=0x7f79f40aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f37fe700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 0x7f79f40aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f37fe700 1 -- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 msgr2=0x7f79f40adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f37fe700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 0x7f79f40adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f37fe700 1 -- 172.21.15.50:0/3640061048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80092a0 con 0x7f79f413dfe0 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f8b9c700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 0x7f79f40aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f3fff700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 0x7f79f40adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.072 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79f37fe700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e900 tx=0x7f79e8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.073 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8013680 con 0x7f79f413dfe0 2022-05-02T09:42:29.073 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80137e0 con 0x7f79f413dfe0 2022-05-02T09:42:29.073 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8013b60 con 0x7f79f413dfe0 2022-05-02T09:42:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e4009370 con 0x7f79f413dfe0 2022-05-02T09:42:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.067+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f40aefd0 con 0x7f79f413dfe0 2022-05-02T09:42:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.068+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f40ac940 con 0x7f79f413dfe0 2022-05-02T09:42:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.069+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f79e8019030 con 0x7f79f413dfe0 2022-05-02T09:42:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.069+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f79e8059900 con 0x7f79f413dfe0 2022-05-02T09:42:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.073+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f79e80387d0 con 0x7f79f413dfe0 2022-05-02T09:42:29.232 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.230+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79f404bfb0 con 0x7f79f413dfe0 2022-05-02T09:42:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.230+0000 7f79dbfff700 1 -- 172.21.15.50:0/3640061048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79e8021030 con 0x7f79f413dfe0 2022-05-02T09:42:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2022-05-02T09:42:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 >> v1:172.21.15.50:6800/36423 conn(0x7f79d4044b40 legacy=0x7f79d4046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 msgr2=0x7f79f4141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e900 tx=0x7f79e8009060 comp rx=0 tx=0).stop 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 shutdown_connections 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f79f413e790 0x7f79f40aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79f40a9830 0x7f79f40adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 --2- 172.21.15.50:0/3640061048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f413dfe0 0x7f79f4141680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 >> 172.21.15.50:0/3640061048 conn(0x7f79f4062df0 msgr2=0x7f79f413c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.232+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 shutdown_connections 2022-05-02T09:42:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.233+0000 7f79fa5ff700 1 -- 172.21.15.50:0/3640061048 wait complete. 2022-05-02T09:42:29.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-02T09:42:29.485 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.482+0000 7f8c089ff700 1 Processor -- start 2022-05-02T09:42:29.485 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.482+0000 7f8c089ff700 1 -- start start 2022-05-02T09:42:29.488 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.483+0000 7f8c089ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c040704b0 0x7f8c0413dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.488 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.483+0000 7f8c089ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c040ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.488 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.483+0000 7f8c089ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040aaff0 con 0x7f8c04141200 2022-05-02T09:42:29.488 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.483+0000 7f8c089ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c04070880 con 0x7f8c040704b0 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.483+0000 7f8c089ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0413e340 con 0x7f8c040ad490 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c040704b0 0x7f8c0413dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c040ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c040704b0 0x7f8c0413dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36288/0 (socket says 172.21.15.50:36288) 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c040ad8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:50844/0 (socket says 172.21.15.50:50844) 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 -- 172.21.15.50:0/3090462763 learned_addr learned my addr 172.21.15.50:0/3090462763 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c02d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c04141200 0x7f8c04141680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52468/0 (socket says 172.21.15.50:52468) 2022-05-02T09:42:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 -- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 msgr2=0x7f8c040ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 --2- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c040ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 -- 172.21.15.50:0/3090462763 >> v1:172.21.15.50:6789/0 conn(0x7f8c04141200 legacy=0x7f8c04141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.484+0000 7f8c0259c700 1 -- 172.21.15.50:0/3090462763 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0413e600 con 0x7f8c040704b0 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c0259c700 1 --2- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413dcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4006fd0 tx=0x7f8bf40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884debf24645614f server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c0159a700 1 -- 172.21.15.50:0/3090462763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4004030 con 0x7f8c040704b0 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c0159a700 1 -- 172.21.15.50:0/3090462763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40041d0 con 0x7f8c040704b0 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c0159a700 1 -- 172.21.15.50:0/3090462763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4011630 con 0x7f8c040704b0 2022-05-02T09:42:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c089ff700 1 -- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 msgr2=0x7f8c0413dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.485+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413dcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4006fd0 tx=0x7f8bf40090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 -- 172.21.15.50:0/3090462763 shutdown_connections 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413dcb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3090462763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c040ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 -- 172.21.15.50:0/3090462763 >> 172.21.15.50:0/3090462763 conn(0x7f8c0406afa0 msgr2=0x7f8c04067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 -- 172.21.15.50:0/3090462763 shutdown_connections 2022-05-02T09:42:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.486+0000 7f8c089ff700 1 -- 172.21.15.50:0/3090462763 wait complete. 2022-05-02T09:42:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.488+0000 7f8c089ff700 1 Processor -- start 2022-05-02T09:42:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.488+0000 7f8c089ff700 1 -- start start 2022-05-02T09:42:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c0406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8c04141200 0x7f8c0413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0406d7a0 con 0x7f8c040704b0 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0406bfe0 con 0x7f8c040ad490 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.489+0000 7f8c089ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0406cd60 con 0x7f8c04141200 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c0406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36290/0 (socket says 172.21.15.50:36290) 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 -- 172.21.15.50:0/3128258906 learned_addr learned my addr 172.21.15.50:0/3128258906 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c02d9d700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8c04141200 0x7f8c0413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 -- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8c04141200 msgr2=0x7f8c0413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8c04141200 0x7f8c0413aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 -- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 msgr2=0x7f8c0406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c0406d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c0259c700 1 -- 172.21.15.50:0/3128258906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009370 con 0x7f8c040704b0 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.490+0000 7f8c01d9b700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c0406d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8c0259c700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4008000 tx=0x7f8bf4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40036f0 con 0x7f8c040704b0 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4003850 con 0x7f8c040704b0 2022-05-02T09:42:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0406caf0 con 0x7f8c040704b0 2022-05-02T09:42:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003c10 con 0x7f8c040704b0 2022-05-02T09:42:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.491+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040a8f00 con 0x7f8c040704b0 2022-05-02T09:42:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.492+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0406c2c0 con 0x7f8c040704b0 2022-05-02T09:42:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.493+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f8bf402b030 con 0x7f8c040704b0 2022-05-02T09:42:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.493+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f8bf405aea0 con 0x7f8c040704b0 2022-05-02T09:42:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.497+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f8bf402f6d0 con 0x7f8c040704b0 2022-05-02T09:42:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.654+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c0406cf20 con 0x7f8c040704b0 2022-05-02T09:42:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.655+0000 7f8bf27fc700 1 -- 172.21.15.50:0/3128258906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8bf4029020 con 0x7f8c040704b0 2022-05-02T09:42:29.659 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2022-05-02T09:42:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 >> v1:172.21.15.50:6800/36423 conn(0x7f8be0044b40 legacy=0x7f8be0046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 msgr2=0x7f8c0413d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4008000 tx=0x7f8bf4016000 comp rx=0 tx=0).stop 2022-05-02T09:42:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 shutdown_connections 2022-05-02T09:42:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f8c04141200 0x7f8c0413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c040704b0 0x7f8c0413d240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 --2- 172.21.15.50:0/3128258906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8c040ad490 0x7f8c0406d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 >> 172.21.15.50:0/3128258906 conn(0x7f8c0406afa0 msgr2=0x7f8c040a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 shutdown_connections 2022-05-02T09:42:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.657+0000 7f8c089ff700 1 -- 172.21.15.50:0/3128258906 wait complete. 2022-05-02T09:42:29.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-05-02T09:42:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.907+0000 7f7567bff700 1 Processor -- start 2022-05-02T09:42:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.908+0000 7f7567bff700 1 -- start start 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.908+0000 7f7567bff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f756013e790 0x7f7560146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f7567bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 0x7f75601488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f7567bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75600a9310 con 0x7f75600a9830 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f7567bff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600a90a0 con 0x7f756013e790 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f7567bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75600a7fe0 con 0x7f756013dfe0 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f756519a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f756013e790 0x7f7560146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f756619c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 0x7f75601488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f756599b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75600a9830 0x7f75600a5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52470/0 (socket says 172.21.15.50:52470) 2022-05-02T09:42:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.909+0000 7f756599b700 1 -- 172.21.15.50:0/3832824987 learned_addr learned my addr 172.21.15.50:0/3832824987 (peer_addr_for_me v1:172.21.15.50:0/0) 2022-05-02T09:42:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756519a700 1 -- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 msgr2=0x7f75601488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756519a700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 0x7f75601488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756519a700 1 -- 172.21.15.50:0/3832824987 >> v1:172.21.15.50:6789/0 conn(0x7f75600a9830 legacy=0x7f75600a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756519a700 1 -- 172.21.15.50:0/3832824987 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75600a8280 con 0x7f756013e790 2022-05-02T09:42:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f7564999700 1 -- 172.21.15.50:0/3832824987 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986435315 0 0) 0x7f75600a9310 con 0x7f75600a9830 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756619c700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 0x7f75601488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f756519a700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756013e790 0x7f7560146370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7550009760 tx=0x7f7550009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2e756e15889ec0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f7564999700 1 -- 172.21.15.50:0/3832824987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550011630 con 0x7f756013e790 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f7564999700 1 -- 172.21.15.50:0/3832824987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7550011790 con 0x7f756013e790 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.910+0000 7f7564999700 1 -- 172.21.15.50:0/3832824987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550011b50 con 0x7f756013e790 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 -- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756013e790 msgr2=0x7f7560146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756013e790 0x7f7560146370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7550009760 tx=0x7f7550009060 comp rx=0 tx=0).stop 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 -- 172.21.15.50:0/3832824987 shutdown_connections 2022-05-02T09:42:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013dfe0 0x7f75601488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 --2- 172.21.15.50:0/3832824987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756013e790 0x7f7560146370 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 -- 172.21.15.50:0/3832824987 >> 172.21.15.50:0/3832824987 conn(0x7f7560062df0 msgr2=0x7f75600631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:29.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 -- 172.21.15.50:0/3832824987 shutdown_connections 2022-05-02T09:42:29.918 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.911+0000 7f7567bff700 1 -- 172.21.15.50:0/3832824987 wait complete. 2022-05-02T09:42:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.913+0000 7f7567bff700 1 Processor -- start 2022-05-02T09:42:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.913+0000 7f7567bff700 1 -- start start 2022-05-02T09:42:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.913+0000 7f7567bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f7567bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 0x7f75600af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f7567bff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 0x7f756013a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f7567bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75600aeb80 con 0x7f75600a9830 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f7567bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75600acc90 con 0x7f756013dfe0 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f7567bff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75600adf40 con 0x7f756013e790 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756519a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 0x7f75600af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36294/0 (socket says 172.21.15.50:36294) 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 -- 172.21.15.50:0/2522147533 learned_addr learned my addr 172.21.15.50:0/2522147533 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756619c700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 0x7f756013a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 -- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 msgr2=0x7f756013a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 0x7f756013a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 -- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 msgr2=0x7f75600af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 0x7f75600af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756599b700 1 -- 172.21.15.50:0/2522147533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009a20 con 0x7f75600a9830 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.914+0000 7f756519a700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 0x7f75600af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f756619c700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 0x7f756013a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f756599b700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f755c0011e0 tx=0x7f755c007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c007360 con 0x7f75600a9830 2022-05-02T09:42:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c0074c0 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75500092a0 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0048e0 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.915+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75600ae8a0 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.916+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75600acae0 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.917+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f755c010030 con 0x7f75600a9830 2022-05-02T09:42:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.917+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f755c0592a0 con 0x7f75600a9830 2022-05-02T09:42:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:29.921+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f755c038230 con 0x7f75600a9830 2022-05-02T09:42:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.079+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f756004bfb0 con 0x7f75600a9830 2022-05-02T09:42:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.079+0000 7f754dffb700 1 -- 172.21.15.50:0/2522147533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f755c03ba20 con 0x7f75600a9830 2022-05-02T09:42:30.083 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2022-05-02T09:42:30.085 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 >> v1:172.21.15.50:6800/36423 conn(0x7f7540044b40 legacy=0x7f7540046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.085 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 msgr2=0x7f75600b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.085 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f755c0011e0 tx=0x7f755c007c40 comp rx=0 tx=0).stop 2022-05-02T09:42:30.085 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 shutdown_connections 2022-05-02T09:42:30.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f756013e790 0x7f756013a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.086 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600a9830 0x7f75600b1720 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 --2- 172.21.15.50:0/2522147533 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f756013dfe0 0x7f75600af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 >> 172.21.15.50:0/2522147533 conn(0x7f7560062df0 msgr2=0x7f75600a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:30.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 shutdown_connections 2022-05-02T09:42:30.087 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.081+0000 7f7567bff700 1 -- 172.21.15.50:0/2522147533 wait complete. 2022-05-02T09:42:30.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-05-02T09:42:30.337 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.334+0000 7f56735ff700 1 Processor -- start 2022-05-02T09:42:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.334+0000 7f56735ff700 1 -- start start 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.335+0000 7f56735ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.335+0000 7f56735ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 0x7f566c141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.335+0000 7f56735ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0aaff0 con 0x7f566c0ad490 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.335+0000 7f56735ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c070880 con 0x7f566c0704b0 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.335+0000 7f56735ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0add20 con 0x7f566c0ad8e0 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f567139b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f5671b9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 0x7f566c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f567139b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36296/0 (socket says 172.21.15.50:36296) 2022-05-02T09:42:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f567139b700 1 -- 172.21.15.50:0/3048850070 learned_addr learned my addr 172.21.15.50:0/3048850070 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f5671b9c700 1 -- 172.21.15.50:0/3048850070 >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 msgr2=0x7f566c13dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f5671b9c700 1 --2- 172.21.15.50:0/3048850070 >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f5671b9c700 1 -- 172.21.15.50:0/3048850070 >> v1:172.21.15.50:6789/0 conn(0x7f566c0ad490 legacy=0x7f566c141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f5671b9c700 1 -- 172.21.15.50:0/3048850070 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c13e340 con 0x7f566c0ad8e0 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f565bfff700 1 -- 172.21.15.50:0/3048850070 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319416220 0 0) 0x7f566c0aaff0 con 0x7f566c0ad490 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.336+0000 7f567139b700 1 --2- 172.21.15.50:0/3048850070 >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f5671b9c700 1 --2- 172.21.15.50:0/3048850070 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 0x7f566c141910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5664009e60 tx=0x7f5664009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c78e8f09a280e1e server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f565bfff700 1 -- 172.21.15.50:0/3048850070 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400e070 con 0x7f566c0ad8e0 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f565bfff700 1 -- 172.21.15.50:0/3048850070 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400bb60 con 0x7f566c0ad8e0 2022-05-02T09:42:30.413 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f565bfff700 1 -- 172.21.15.50:0/3048850070 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664012430 con 0x7f566c0ad8e0 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f56735ff700 1 -- 172.21.15.50:0/3048850070 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 msgr2=0x7f566c141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.337+0000 7f56735ff700 1 --2- 172.21.15.50:0/3048850070 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 0x7f566c141910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5664009e60 tx=0x7f5664009780 comp rx=0 tx=0).stop 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 -- 172.21.15.50:0/3048850070 shutdown_connections 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 --2- 172.21.15.50:0/3048850070 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0ad8e0 0x7f566c141910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 --2- 172.21.15.50:0/3048850070 >> v2:172.21.15.50:3300/0 conn(0x7f566c0704b0 0x7f566c13dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 -- 172.21.15.50:0/3048850070 >> 172.21.15.50:0/3048850070 conn(0x7f566c06afa0 msgr2=0x7f566c067190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 -- 172.21.15.50:0/3048850070 shutdown_connections 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.338+0000 7f56735ff700 1 -- 172.21.15.50:0/3048850070 wait complete. 2022-05-02T09:42:30.414 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.339+0000 7f56735ff700 1 Processor -- start 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.339+0000 7f56735ff700 1 -- start start 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 0x7f566c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f566c0ad8e0 0x7f566c13f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c141340 con 0x7f566c0ad490 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c142fb0 con 0x7f566c0ad8e0 2022-05-02T09:42:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f56735ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566c141570 con 0x7f566c0704b0 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f567139b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f5670b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 0x7f566c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f567139b700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50162/0 (socket says 172.21.15.50:50162) 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f567139b700 1 -- 172.21.15.50:0/3101564085 learned_addr learned my addr 172.21.15.50:0/3101564085 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.340+0000 7f5671b9c700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f566c0ad8e0 0x7f566c13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 -- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f566c0ad8e0 msgr2=0x7f566c13f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f566c0ad8e0 0x7f566c13f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 -- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 msgr2=0x7f566c143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 0x7f566c143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 -- 172.21.15.50:0/3101564085 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668009370 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f5670b9a700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 0x7f566c143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f567139b700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f566800ea50 tx=0x7f56680090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800ee90 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800c850 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.341+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800cc10 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.342+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5664009a20 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.342+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c143cd0 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.343+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c142940 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.343+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f5668019030 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.344+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5668059870 con 0x7f566c0704b0 2022-05-02T09:42:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.347+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f5668038890 con 0x7f566c0704b0 2022-05-02T09:42:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.504+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f566c0afdc0 con 0x7f566c0704b0 2022-05-02T09:42:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.505+0000 7f56597fa700 1 -- 172.21.15.50:0/3101564085 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f566803beb0 con 0x7f566c0704b0 2022-05-02T09:42:30.508 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 >> v1:172.21.15.50:6800/36423 conn(0x7f564c044b40 legacy=0x7f564c046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 msgr2=0x7f566c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f566800ea50 tx=0x7f56680090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 shutdown_connections 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f566c0704b0 0x7f566c06e490 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f566c0ad8e0 0x7f566c13f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 --2- 172.21.15.50:0/3101564085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566c0ad490 0x7f566c143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 >> 172.21.15.50:0/3101564085 conn(0x7f566c06afa0 msgr2=0x7f566c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 shutdown_connections 2022-05-02T09:42:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.507+0000 7f56735ff700 1 -- 172.21.15.50:0/3101564085 wait complete. 2022-05-02T09:42:30.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-02T09:42:30.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.753+0000 7f83569ff700 1 Processor -- start 2022-05-02T09:42:30.756 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.754+0000 7f83569ff700 1 -- start start 2022-05-02T09:42:30.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.754+0000 7f83569ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f835013e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.754+0000 7f83569ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83500a6770 0x7f83500a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.758 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.754+0000 7f83569ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 0x7f8350140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f83569ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500aa210 con 0x7f83500a6770 2022-05-02T09:42:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f83569ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500a9cb0 con 0x7f83500a98e0 2022-05-02T09:42:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f83569ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83500a8f20 con 0x7f83500a8600 2022-05-02T09:42:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83500a6770 0x7f83500a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f8354f9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 0x7f8350140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f835013e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83500a6770 0x7f83500a80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36300/0 (socket says 172.21.15.50:36300) 2022-05-02T09:42:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834f7fe700 1 -- 172.21.15.50:0/2641107341 learned_addr learned my addr 172.21.15.50:0/2641107341 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f8354f9c700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 0x7f8350140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50164/0 (socket says 172.21.15.50:50164) 2022-05-02T09:42:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834f7fe700 1 -- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 msgr2=0x7f8350140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.755+0000 7f834f7fe700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 0x7f8350140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834f7fe700 1 -- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 msgr2=0x7f835013e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-02T09:42:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834f7fe700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f835013e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834f7fe700 1 -- 172.21.15.50:0/2641107341 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500a7e00 con 0x7f83500a6770 2022-05-02T09:42:30.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834ffff700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f835013e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:30.762 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834f7fe700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a6770 0x7f83500a80c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8344006fd0 tx=0x7f83440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1444c23d0c28a6 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:30.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834effd700 1 -- 172.21.15.50:0/2641107341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344004030 con 0x7f83500a6770 2022-05-02T09:42:30.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834effd700 1 -- 172.21.15.50:0/2641107341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8344004190 con 0x7f83500a6770 2022-05-02T09:42:30.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.756+0000 7f834effd700 1 -- 172.21.15.50:0/2641107341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344011630 con 0x7f83500a6770 2022-05-02T09:42:30.766 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 -- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a6770 msgr2=0x7f83500a80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a6770 0x7f83500a80c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8344006fd0 tx=0x7f83440090f0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 -- 172.21.15.50:0/2641107341 shutdown_connections 2022-05-02T09:42:30.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a8600 0x7f8350140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f835013e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.767 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 --2- 172.21.15.50:0/2641107341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a6770 0x7f83500a80c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 -- 172.21.15.50:0/2641107341 >> 172.21.15.50:0/2641107341 conn(0x7f8350062df0 msgr2=0x7f83500631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 -- 172.21.15.50:0/2641107341 shutdown_connections 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.757+0000 7f83569ff700 1 -- 172.21.15.50:0/2641107341 wait complete. 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.759+0000 7f83569ff700 1 Processor -- start 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.759+0000 7f83569ff700 1 -- start start 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 0x7f8350150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f83500abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-02T09:42:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500ae7c0 con 0x7f83500a8600 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500ad270 con 0x7f83500a98e0 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.760+0000 7f83569ff700 1 -- --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8350151300 con 0x7f83500a6770 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f8354f9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f83500abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 --2- >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3302/0 says I am v2:172.21.15.50:50166/0 (socket says 172.21.15.50:50166) 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 0x7f8350150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 -- 172.21.15.50:0/3944416038 learned_addr learned my addr 172.21.15.50:0/3944416038 (peer_addr_for_me v2:172.21.15.50:0/0) 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 -- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 msgr2=0x7f83500abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f83500abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 -- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 msgr2=0x7f8350150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 0x7f8350150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834ffff700 1 -- 172.21.15.50:0/3944416038 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400092a0 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.761+0000 7f834f7fe700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 0x7f8350150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f834ffff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9b0 tx=0x7f8340009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340013680 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400137e0 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340013b60 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8344009370 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.762+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8350150fc0 con 0x7f83500a6770 2022-05-02T09:42:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.763+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835004bfb0 con 0x7f83500a6770 2022-05-02T09:42:30.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.763+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 4 ==== mgrmap(e 9) v1 ==== 52884+0+0 (secure 0 0 0) 0x7f8340019030 con 0x7f83500a6770 2022-05-02T09:42:30.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.764+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f83400597d0 con 0x7f83500a6770 2022-05-02T09:42:30.771 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.768+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+130622 (secure 0 0 0) 0x7f83400387f0 con 0x7f83500a6770 2022-05-02T09:42:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.954+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 --> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f835013dfd0 con 0x7f83500a6770 2022-05-02T09:42:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.955+0000 7f8337fff700 1 -- 172.21.15.50:0/3944416038 <== mon.2 v2:172.21.15.50:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3666 (secure 0 0 0) 0x7f834003be10 con 0x7f83500a6770 2022-05-02T09:42:30.958 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-05-02T09:42:30.958 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14392,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6817/273975332","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6817","nonce":273975332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":14399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6818/3607500817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6818","nonce":3607500817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-05-02T09:39:11.302771+0000","modified":"2022-05-02T09:42:20.217413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14405},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14405":{"gid":14405,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6819/4055571573","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6819","nonce":4055571573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 >> v1:172.21.15.50:6800/36423 conn(0x7f8330044b40 legacy=0x7f8330046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 msgr2=0x7f83500b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9b0 tx=0x7f8340009060 comp rx=0 tx=0).stop 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 shutdown_connections 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3302/0,v1:172.21.15.50:6791/0] conn(0x7f83500a6770 0x7f83500b30a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83500a98e0 0x7f83500abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 --2- 172.21.15.50:0/3944416038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83500a8600 0x7f8350150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-02T09:42:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 >> 172.21.15.50:0/3944416038 conn(0x7f8350062df0 msgr2=0x7f83501409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-02T09:42:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 shutdown_connections 2022-05-02T09:42:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2022-05-02T09:42:30.957+0000 7f83569ff700 1 -- 172.21.15.50:0/3944416038 wait complete. 2022-05-02T09:42:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 20 2022-05-02T09:42:31.186 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/ceph.py", line 1474, in healthy ceph_fs.wait_for_daemons(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/cephfs/filesystem.py", line 1080, in wait_for_daemons if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/cephfs/filesystem.py", line 927, in are_daemons_healthy mds.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2022-05-02T09:42:31.292 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2e66535ce0c84a66b3743960aeca9730 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/ceph.py", line 1474, in healthy ceph_fs.wait_for_daemons(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/cephfs/filesystem.py", line 1080, in wait_for_daemons if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): File "/home/teuthworker/src/git.ceph.com_ceph-c_b82312f270e887c49dafe642c4ee39a73bc7d8fa/qa/tasks/cephfs/filesystem.py", line 927, in are_daemons_healthy mds.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2022-05-02T09:42:31.295 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-05-02T09:42:31.310 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2022-05-02T09:42:31.454 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-05-02T09:42:31.552 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-05-02T09:42:31.644 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2022-05-02T09:42:31.742 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2022-05-02T09:42:31.803 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2022-05-02T09:42:31.803 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2022-05-02T09:42:31.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:42:31.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2022-05-02T09:42:31.917 INFO:teuthology.orchestra.run.smithi073.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2022-05-02T09:42:31.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-02T09:42:31.922 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi073.front.sepia.ceph.com, aborting... 2022-05-02T09:42:31.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-05-02T09:42:31.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2022-05-02T09:42:53.230 INFO:tasks.ceph.mds.b.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7effd07ed700 time 2022-05-02T09:42:53.226719+0000 2022-05-02T09:42:53.231 INFO:tasks.ceph.mds.b.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:53.231 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.231 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7effe0085114] 2022-05-02T09:42:53.231 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.231 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.232 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: clone() 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr:2022-05-02T09:42:53.226+0000 7effd07ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7effd07ed700 time 2022-05-02T09:42:53.226719+0000 2022-05-02T09:42:53.233 INFO:tasks.ceph.mds.b.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:53.234 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.234 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.234 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7effe0085114] 2022-05-02T09:42:53.234 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.234 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.235 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: clone() 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr:*** Caught signal (Aborted) ** 2022-05-02T09:42:53.236 INFO:tasks.ceph.mds.b.smithi050.stderr: in thread 7effd07ed700 thread_name:mds_rank_progr 2022-05-02T09:42:53.237 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.237 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7effde812ce0] 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: abort() 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7effe0085172] 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.238 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.239 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr: 16: clone() 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr:2022-05-02T09:42:53.228+0000 7effd07ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr: in thread 7effd07ed700 thread_name:mds_rank_progr 2022-05-02T09:42:53.240 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7effde812ce0] 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: abort() 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7effe0085172] 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.241 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.242 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: 16: clone() 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:53.243 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr: -1> 2022-05-02T09:42:53.226+0000 7effd07ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7effd07ed700 time 2022-05-02T09:42:53.226719+0000 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7effe0085114] 2022-05-02T09:42:53.244 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.245 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: clone() 2022-05-02T09:42:53.246 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: 0> 2022-05-02T09:42:53.228+0000 7effd07ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: in thread 7effd07ed700 thread_name:mds_rank_progr 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7effde812ce0] 2022-05-02T09:42:53.247 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: abort() 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7effe0085172] 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.248 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.249 INFO:tasks.ceph.mds.b.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.250 INFO:tasks.ceph.mds.b.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.250 INFO:tasks.ceph.mds.b.smithi050.stderr: 16: clone() 2022-05-02T09:42:53.250 INFO:tasks.ceph.mds.b.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:53.250 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr: -1> 2022-05-02T09:42:53.226+0000 7effd07ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7effd07ed700 time 2022-05-02T09:42:53.226719+0000 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7effe0085114] 2022-05-02T09:42:53.251 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.252 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: clone() 2022-05-02T09:42:53.253 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: 0> 2022-05-02T09:42:53.228+0000 7effd07ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: in thread 7effd07ed700 thread_name:mds_rank_progr 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7effde812ce0] 2022-05-02T09:42:53.254 INFO:tasks.ceph.mds.b.smithi050.stderr: 2: gsignal() 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 3: abort() 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7effe0085172] 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7effe0085335] 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x558f5903a5ed] 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x558f58ede799] 2022-05-02T09:42:53.255 INFO:tasks.ceph.mds.b.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x558f58ee012e] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x558f58f232d6] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x558f58f23618] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x558f58f92e07] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x558f590fbc13] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x558f58dda764] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x558f58ddae95] 2022-05-02T09:42:53.256 INFO:tasks.ceph.mds.b.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7effde8081cf] 2022-05-02T09:42:53.257 INFO:tasks.ceph.mds.b.smithi050.stderr: 16: clone() 2022-05-02T09:42:53.257 INFO:tasks.ceph.mds.b.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:42:53.257 INFO:tasks.ceph.mds.b.smithi050.stderr: 2022-05-02T09:42:53.485 INFO:tasks.ceph.mds.b.smithi050.stderr:daemon-helper: command crashed with signal 6 2022-05-02T09:43:13.232 INFO:tasks.ceph.mds.a.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f442e7ed700 time 2022-05-02T09:43:13.230774+0000 2022-05-02T09:43:13.233 INFO:tasks.ceph.mds.a.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:43:13.234 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.234 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f443e085114] 2022-05-02T09:43:13.235 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.235 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.235 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.235 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.236 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.236 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.237 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.237 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.237 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.238 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.238 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.238 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: clone() 2022-05-02T09:43:13.238 INFO:tasks.ceph.mds.a.smithi050.stderr:2022-05-02T09:43:13.231+0000 7f442e7ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f442e7ed700 time 2022-05-02T09:43:13.230774+0000 2022-05-02T09:43:13.238 INFO:tasks.ceph.mds.a.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:43:13.239 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.239 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.239 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f443e085114] 2022-05-02T09:43:13.239 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.239 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.240 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.240 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.240 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.240 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.240 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.241 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.241 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.241 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.241 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.241 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: clone() 2022-05-02T09:43:13.242 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.242 INFO:tasks.ceph.mds.a.smithi050.stderr:*** Caught signal (Aborted) ** 2022-05-02T09:43:13.242 INFO:tasks.ceph.mds.a.smithi050.stderr: in thread 7f442e7ed700 thread_name:mds_rank_progr 2022-05-02T09:43:13.243 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.243 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f443c812ce0] 2022-05-02T09:43:13.243 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: gsignal() 2022-05-02T09:43:13.243 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: abort() 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f443e085172] 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.244 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.245 INFO:tasks.ceph.mds.a.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr: 16: clone() 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr:2022-05-02T09:43:13.233+0000 7f442e7ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr: in thread 7f442e7ed700 thread_name:mds_rank_progr 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.246 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f443c812ce0] 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: gsignal() 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: abort() 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f443e085172] 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.247 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.248 INFO:tasks.ceph.mds.a.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr: 16: clone() 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr: -1> 2022-05-02T09:43:13.231+0000 7f442e7ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f442e7ed700 time 2022-05-02T09:43:13.230774+0000 2022-05-02T09:43:13.249 INFO:tasks.ceph.mds.a.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f443e085114] 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.250 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.251 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.251 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.251 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.251 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.251 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.252 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.252 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.252 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.252 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: clone() 2022-05-02T09:43:13.252 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: 0> 2022-05-02T09:43:13.233+0000 7f442e7ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: in thread 7f442e7ed700 thread_name:mds_rank_progr 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f443c812ce0] 2022-05-02T09:43:13.253 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: gsignal() 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: abort() 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f443e085172] 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.254 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.255 INFO:tasks.ceph.mds.a.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.256 INFO:tasks.ceph.mds.a.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.256 INFO:tasks.ceph.mds.a.smithi050.stderr: 16: clone() 2022-05-02T09:43:13.256 INFO:tasks.ceph.mds.a.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:43:13.256 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr: -1> 2022-05-02T09:43:13.231+0000 7f442e7ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f442e7ed700 time 2022-05-02T09:43:13.230774+0000 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11888-gb82312f2/rpm/el8/BUILD/ceph-17.0.0-11888-gb82312f2/src/mds/CDir.cc: 294: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f443e085114] 2022-05-02T09:43:13.257 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.258 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: clone() 2022-05-02T09:43:13.259 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: 0> 2022-05-02T09:43:13.233+0000 7f442e7ed700 -1 *** Caught signal (Aborted) ** 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: in thread 7f442e7ed700 thread_name:mds_rank_progr 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: ceph version 17.0.0-11888-gb82312f2 (b82312f270e887c49dafe642c4ee39a73bc7d8fa) quincy (dev) 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f443c812ce0] 2022-05-02T09:43:13.260 INFO:tasks.ceph.mds.a.smithi050.stderr: 2: gsignal() 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 3: abort() 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f443e085172] 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f443e085335] 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55bc3f83a5ed] 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x12a9) [0x55bc3f6de799] 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x64e) [0x55bc3f6e012e] 2022-05-02T09:43:13.261 INFO:tasks.ceph.mds.a.smithi050.stderr: 9: (MDCache::populate_mydir()+0x846) [0x55bc3f7232d6] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 10: (MDCache::open_root()+0xd8) [0x55bc3f723618] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55bc3f792e07] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 12: (MDSContext::complete(int)+0x203) [0x55bc3f8fbc13] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55bc3f5da764] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55bc3f5dae95] 2022-05-02T09:43:13.262 INFO:tasks.ceph.mds.a.smithi050.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f443c8081cf] 2022-05-02T09:43:13.263 INFO:tasks.ceph.mds.a.smithi050.stderr: 16: clone() 2022-05-02T09:43:13.263 INFO:tasks.ceph.mds.a.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-05-02T09:43:13.263 INFO:tasks.ceph.mds.a.smithi050.stderr: 2022-05-02T09:43:13.512 INFO:tasks.ceph.mds.a.smithi050.stderr:daemon-helper: command crashed with signal 6 2022-05-02T09:47:31.932 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-05-02T09:47:31.949 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-05-02T12:05:11.342 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T12:05:11.337+0000 7fe8f6ffe700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-05-02T13:11:07.719 INFO:tasks.ceph.mgr.x.smithi050.stderr:2022-05-02T13:11:07.714+0000 7fe8f6ffe700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-05-02T15:59:25.023 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-05-02T15:59:25.037 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2022-05-02T15:59:25.038 DEBUG:teuthology.task.console_log:Killing console logger for smithi073 2022-05-02T15:59:25.038 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2022-05-02T15:59:25.039 DEBUG:teuthology.exit:Finished running handlers